Sep 01 12:29:08 devstack cinder-volume[76151]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 12:29:08 devstack cinder-volume[76151]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:29:08 devstack cinder-volume[76151]: we strongly recommend against using it for new projects. Sep 01 12:29:08 devstack cinder-volume[76151]: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:29:08 devstack cinder-volume[76151]: framework. For more detail see Sep 01 12:29:08 devstack cinder-volume[76151]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:29:08 devstack cinder-volume[76151]: import eventlet # noqa Sep 01 12:29:11 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:29:11 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:29:11 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:29:11 devstack cinder-volume[76151]: INFO dbcounter [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Registered counter for database cinder Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG dbcounter [-] [76151] Writer thread running {{(pid=76151) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:29:12 devstack cinder-volume[76151]: INFO cinder.rpc [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 12:29:12 devstack cinder-volume[76151]: INFO cinder.rpc [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:29:12 devstack cinder-volume[76151]: INFO cinder.volume.manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Determined volume DB was empty at startup. Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG cinder.volume.manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76151) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 12:29:12 devstack cinder-volume[76151]: INFO cinder.volume.manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 12:29:12 devstack cinder-volume[76151]: WARNING stevedore.named [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:29:12 devstack cinder-volume[76151]: WARNING castellan.key_manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:29:12 devstack cinder-volume[76151]: WARNING cinder.keymgr.conf_key_mgr [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG cinder.volume.drivers.lvm [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76151) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 12:29:12 devstack cinder-volume[76151]: DEBUG oslo_concurrency.processutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_concurrency.processutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] CMD "cinder-rtstool verify" returned: 0 in 0.560s {{(pid=76151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:29:13 devstack cinder-volume[76151]: INFO cinder.rpc [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 12:29:13 devstack cinder-volume[76151]: INFO cinder.rpc [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 12:29:13 devstack cinder-volume[76151]: WARNING stevedore.named [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:29:13 devstack cinder-volume[76151]: WARNING castellan.key_manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:29:13 devstack cinder-volume[76151]: INFO cinder.volume.manager [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_db.sqlalchemy.engines [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:29:13 devstack cinder-volume[76151]: INFO oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Starting 1 workers Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Started child 76317 {{(pid=76151) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Full set of CONF: {{(pid=76151) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] ******************************************************************************** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Configuration options gathered from: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] ================================================================================ {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] allow_availability_zone_fallback = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] allow_compression_on_image_upload = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] allowed_direct_url_schemes = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] api_rate_limit = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] auth_strategy = keystone {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] az_cache_duration = 3600 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_availability_zone = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_host = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_stats_polling_interval = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backup_api_class = cinder.backup.api.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backup_name_template = backup-%s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backup_use_same_host = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76317]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backup_use_temp_snapshot = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] chap_password = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] chap_username = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_internal_tenant_project_id = f2f1cafdeca3485da2f0a8e36eb1b395 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_internal_tenant_user_id = 043baf2825754b0786b5b203c639aa9f {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cloned_volume_same_az = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cluster = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] compression_format = gzip {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] compute_api_class = cinder.compute.nova.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] config_dir = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] config_source = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] control_exchange = openstack {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] debug = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] default_availability_zone = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] default_group_type = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] default_volume_type = lvmdriver-1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] disk_geometry = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_client_cert = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_client_cert_key = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_data_namespace = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_ssl_cert_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_ssl_cert_verify = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] driver_use_ssl = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] enable_force_upload = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] enable_new_services = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] enable_unsupported_driver = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] enforce_multipath_for_image_xfer = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] filter_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_api_insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_api_ssl_compression = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_ca_certificates_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_catalog_info = image:glance:publicURL {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_num_retries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance_request_timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] goodness_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] graceful_shutdown_timeout = 5 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] group_api_class = cinder.group.api.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] host = devstack {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_compress_on_upload = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_conversion_address_space_limit = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_conversion_cpu_limit = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_conversion_disable = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_upload_use_cinder_backend = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_upload_use_internal_tenant = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_volume_cache_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_volume_cache_max_count = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] image_volume_cache_max_size_gb = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] init_host_max_objects_retrieval = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] instance_format = [instance: %(uuid)s] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iscsi_target_flags = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iscsi_write_cache = on {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iser_helper = tgtadm {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iser_ip_address = 192.168.122.202 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iser_port = 3260 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_color = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_config_append = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_dir = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_options = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_rotate_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_rotate_interval_type = days {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] log_rotation_type = none {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] max_age = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] max_logfile_count = 30 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] max_logfile_size_mb = 200 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] max_over_subscription_ratio = 20.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] message_reap_interval = 86400 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] message_ttl = 2592000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] migration_create_volume_timeout_secs = 300 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] monkey_patch = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] monkey_patch_modules = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] my_ip = 192.168.122.202 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] no_snapshot_gb_quota = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] num_iser_scan_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] num_shell_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] num_volume_device_scan_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] nvmeof_conn_info_version = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] nvmet_ns_id = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] nvmet_port_id = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_max_limit = 1000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_ext_list = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_listen_port = 8776 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_use_ssl = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] osapi_volume_workers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] per_volume_size_limit = -1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] periodic_fuzzy_delay = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] periodic_interval = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] public_endpoint = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] publish_errors = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_backup_gigabytes = 1000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_backups = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_gigabytes = 1000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_groups = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_snapshots = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] quota_volumes = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] rate_limit_burst = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] rate_limit_except_level = CRITICAL {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] rate_limit_interval = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] reinit_driver_count = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] replication_device = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] report_discard_supported = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] report_interval = 120 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] reservation_clean_interval = 86400 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] reservation_expire = 86400 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] reserved_image_namespaces = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] reserved_percentage = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] rpc_response_timeout = 120 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] run_external_periodic_tasks = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] scst_target_driver = iscsi {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] scst_target_iqn_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_down_time = 720 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] shell_completion = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] snapshot_name_template = snapshot-%s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] snapshot_same_host = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] split_loggers = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] state_path = /opt/stack/data/cinder {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] storage_availability_zone = nova {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] storage_protocol = iSCSI {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] syslog_log_facility = LOG_USER {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_helper = lioadm {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_ip_address = 192.168.122.202 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_port = 3260 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_protocol = iscsi {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] target_secondary_ip_addresses = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] trace_flags = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] transport_url = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] until_refresh = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_chap_auth = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_default_quota_class = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_journal = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_json = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_multipath_for_image_xfer = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_stderr = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] use_syslog = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] verify_glance_signatures = enabled {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_api_class = cinder.volume.api.API {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_backend_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_clear = zero {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_clear_ionice = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_clear_size = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_copy_bps_limit = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_dd_blocksize = 1M {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_name_template = volume-%s {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_service_inithost_offload = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volume_usage_audit_period = month {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] zoning_mode = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_concurrency.disable_process_locking = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.auth_section = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.auth_type = password {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.auth_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.cache = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.include_service_catalog = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.interface = public {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_password = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcache_username = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.region_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.service_type = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.backend = dogpile.cache.null {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.backend_argument = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.backend_expiration_time = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.config_prefix = cache.oslo {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.debug_cache_backend = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.enable_retry_client = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.enable_socket_keepalive = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.expiration_time = 600 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.hashclient_retry_attempts = 2 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_dead_retry = 300 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_pool_maxsize = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_sasl_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.password = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.proxies = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.redis_db = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.redis_server = localhost:6379 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.retry_attempts = 2 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.retry_delay = 0.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.socket_keepalive_count = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.socket_keepalive_idle = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.socket_keepalive_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.socket_timeout = 1.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.tls_allowed_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.tls_cafile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.tls_certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.tls_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.tls_keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cache.username = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] coordination.backend_url = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.asyncio_connection = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.asyncio_slave_connection = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.backend = sqlalchemy {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.connection = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.connection_debug = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.connection_parameters = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.connection_recycle_time = 3600 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.connection_trace = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.db_inc_retry_interval = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.db_max_retries = 20 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.db_max_retry_interval = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.db_retry_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.max_overflow = 50 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.max_pool_size = 5 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.max_retries = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.mysql_wsrep_sync_wait = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.pool_timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.retry_interval = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.slave_connection = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.sqlite_synchronous = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.synchronous_reader = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] database.use_db_reconnect = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_tracing.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.connection_string = messaging:// {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.es_doc_type = notification {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.es_scroll_size = 10000 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.es_scroll_time = 2m {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.filter_error_trace = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.hmac_keys = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.sentinel_service_name = mymaster {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.socket_timeout = 0.1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.trace_requests = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler.trace_sqlalchemy = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler_jaeger.process_tags = {} {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler_jaeger.service_name_prefix = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] profiler_otlp.service_name_prefix = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.enforce_new_defaults = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.policy_default_rule = default {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.policy_file = policy.yaml {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.group = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.helper_command = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] privsep_osbrick.user = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.group = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.helper_command = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] cinder_sys_admin.user = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.auth_section = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.auth_type = password {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.cafile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.collect_timing = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.send_service_user_token = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.split_loggers = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.tls_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] service_user.tls_min_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.auth_section = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.auth_type = password {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.collect_timing = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.region_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.split_loggers = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.tls_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] glance.tls_min_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.backend_availability_zone = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.chap_password = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.chap_username = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.disk_geometry = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_client_cert = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_client_cert_key = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_data_namespace = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.driver_use_ssl = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.extra_capabilities = {} {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.filter_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.goodness_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iscsi_target_flags = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iscsi_write_cache = on {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iser_helper = tgtadm {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iser_port = 3260 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.lvm_share_target = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.lvm_type = auto {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.num_shell_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.replication_device = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.report_discard_supported = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.reserved_percentage = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_helper = tgtadm {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_port = 3260 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_protocol = iscsi {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.trace_flags = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.unique_fqdn_network = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.use_chap_auth = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_backend_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_clear = zero {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_clear_ionice = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_clear_size = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_reports.file_event_handler = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_reports.log_dir = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.backend_host = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.chap_password = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.chap_username = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.disk_geometry = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_client_cert = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.extra_capabilities = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.filter_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.goodness_function = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iser_helper = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iser_ip_address = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iser_port = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.lvm_share_target = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.lvm_type = auto {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.num_shell_tries = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.replication_device = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.report_discard_supported = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.reserved_percentage = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.scst_target_driver = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.storage_protocol = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_helper = lioadm {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_ip_address = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_port = 3260 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.trace_flags = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.use_chap_auth = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_clear = zero {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_clear_size = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] lvmdriver-1.volumes_dir = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_notifications.driver = [] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_notifications.retry = -1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] key_manager.fixed_key = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.barbican_api_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.barbican_endpoint = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.barbican_endpoint_type = public {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.barbican_region_name = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.cafile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.collect_timing = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.number_of_retries = 60 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.retry_delay = 1 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.send_service_user_token = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.split_loggers = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.tls_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.tls_min_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.verify_ssl = True {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican.verify_ssl_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.auth_section = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.auth_type = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.cafile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.certfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.collect_timing = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.insecure = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.keyfile = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.split_loggers = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.timeout = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.tls_ciphers = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] barbican_service_user.tls_min_version = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.approle_role_id = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.approle_secret_id = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.auth_method = approle {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.auth_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.kv_mountpoint = secret {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.kv_path = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.kv_version = 2 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.namespace = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.root_token_id = **** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.ssl_ca_crt_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.timeout = 60.0 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.token_file = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.token_role = None {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.use_ssl = False {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:29:13 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] ******************************************************************************** {{(pid=76151) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 12:29:13 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:13 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:13 devstack sudo[76469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:13 devstack sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:14 devstack sudo[76469]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.272s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:29:14 devstack cinder-volume[76317]: INFO cinder.brick.local_dev.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:14 devstack sudo[76562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:14 devstack sudo[76562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:14 devstack sudo[76562]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG cinder.brick.local_dev.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76317) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:14 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:14 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:14 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:14 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:14 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:14 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:15 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:15 devstack sudo[76913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 12:29:15 devstack sudo[76913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:15 devstack sudo[76913]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:15 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:15 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:15 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.363s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:15 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:15 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:15 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:16 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:16 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:16 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:16 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:16 devstack sudo[77098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:16 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:16 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:16 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:16 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:16 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: INFO cinder.volume.drivers.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:16 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:17 devstack sudo[77106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:17 devstack sudo[77106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:17 devstack sudo[77106]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:17 devstack sudo[77109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:17 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:17 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:17 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:17 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:17 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:17 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:17 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:17 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:18 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:18 devstack sudo[77118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:18 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:18 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:18 devstack cinder-volume[76317]: INFO cinder.volume.driver [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG cinder.volume.driver [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76317) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_db.sqlalchemy.engines [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writer thread running {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG cinder.db.api [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Building query based on filter {{(pid=76317) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG cinder.image.image_utils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76317) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 12:29:18 devstack cinder-volume[76317]: INFO cinder.keymgr.migration [None req-e7c4cafc-18c8-48a9-b447-91aa7d8b383f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:18 devstack sudo[77124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:18 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:18 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:18 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:18 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:18 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:19 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:19 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:19 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:19 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:19 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:19 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:19 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:29:19 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Driver initialization completed successfully. Sep 01 12:29:19 devstack cinder-volume[76317]: INFO cinder.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Initiating service 2 cleanup Sep 01 12:29:19 devstack cinder-volume[76317]: INFO cinder.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Service 2 cleanup completed. Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG cinder.service [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Creating RPC server for service cinder-volume {{(pid=76317) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG cinder.service [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76317) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 12:29:19 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:29:19 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:19 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:29:19 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:20 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:20 devstack sudo[77144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:20 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:20 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:20 devstack sudo[77147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:29:20 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:20 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:29:20 devstack sudo[77150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:29:20 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:29:20 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root Sep 01 12:29:20 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:29:21 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-267a31eb-5d8e-4af2-aeb2-3aa9689eccb9 None None] Driver post RPC initialization completed successfully. Sep 01 12:29:23 devstack cinder-volume[76151]: DEBUG dbcounter [-] [76151] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76151) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:29:30 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:29:31 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:30:21 devstack sudo[79176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:30:21 devstack sudo[79176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:30:21 devstack sudo[79176]: pam_unix(sudo:session): session closed for user root Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:30:21 devstack sudo[79179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:30:21 devstack sudo[79179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:30:21 devstack sudo[79179]: pam_unix(sudo:session): session closed for user root Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:30:21 devstack sudo[79182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:30:21 devstack sudo[79182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:30:21 devstack sudo[79182]: pam_unix(sudo:session): session closed for user root Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:30:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:30:21 devstack sudo[79185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:30:21 devstack sudo[79185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:30:22 devstack sudo[79185]: pam_unix(sudo:session): session closed for user root Sep 01 12:30:22 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:30:22 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:30:22 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:30:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:30:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread info: [<_MainThread(MainThread, started 139212211482752)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:31:21 devstack sudo[82536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:31:21 devstack sudo[82536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:31:21 devstack sudo[82536]: pam_unix(sudo:session): session closed for user root Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:31:21 devstack sudo[82539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:31:21 devstack sudo[82539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:31:21 devstack sudo[82539]: pam_unix(sudo:session): session closed for user root Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:31:21 devstack sudo[82558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:31:21 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:31:21 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:31:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:31:21 devstack sudo[82561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:31:21 devstack sudo[82561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:31:22 devstack sudo[82561]: pam_unix(sudo:session): session closed for user root Sep 01 12:31:22 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:31:22 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:31:31 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:31:31 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:32:21 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:32:21 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:32:21 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:32:21 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:32:21 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:32:21 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:32:21 devstack sudo[84572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:32:21 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:32:21 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:32:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:32:21 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:32:21 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:32:22 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Sep 01 12:32:22 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:32:22 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:32:22 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:32:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:32:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread info: [<_MainThread(MainThread, started 139212211482752)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:21 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 12:33:21 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:21 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:21 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:33:21 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:21 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:21 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 12:33:21 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:21 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:21 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:21 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 12:33:21 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:22 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:22 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:22 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:33:22 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:33:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:33:22 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-e24d0a07-e422-48e3-8a04-419ad367d2fd None None] thread info: [<_MainThread(MainThread, started 139212211482752)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:33:31 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:33:41 devstack cinder-volume[76151]: INFO oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Caught SIGTERM, stopping children Sep 01 12:33:41 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Acquiring lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:41 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Acquired lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:41 devstack cinder-volume[76151]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Releasing lock "singleton_lock" {{(pid=76151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:41 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Stop services. {{(pid=76151) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 12:33:41 devstack cinder-volume[76151]: DEBUG oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Killing children. {{(pid=76151) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 12:33:41 devstack cinder-volume[76151]: INFO oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Waiting on 1 children to exit Sep 01 12:33:44 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Acquiring lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:44 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Acquired lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:44 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Releasing lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:44 devstack cinder-volume[76317]: WARNING amqp [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:33:44 devstack cinder-volume[76317]: WARNING amqp [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:33:44 devstack cinder-volume[76151]: INFO oslo_service.backend._eventlet.service [None req-e6b55296-895a-492b-bea7-9092e9293d15 None None] Child 76317 exited with status 0 Sep 01 12:33:45 devstack cinder-volume[86315]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 12:33:45 devstack cinder-volume[86315]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:33:45 devstack cinder-volume[86315]: we strongly recommend against using it for new projects. Sep 01 12:33:45 devstack cinder-volume[86315]: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:33:45 devstack cinder-volume[86315]: framework. For more detail see Sep 01 12:33:45 devstack cinder-volume[86315]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:33:45 devstack cinder-volume[86315]: import eventlet # noqa Sep 01 12:33:47 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:47 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:47 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:47 devstack cinder-volume[86315]: INFO dbcounter [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Registered counter for database cinder Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG dbcounter [-] [86315] Writer thread running {{(pid=86315) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:33:48 devstack cinder-volume[86315]: INFO cinder.rpc [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 12:33:48 devstack cinder-volume[86315]: INFO cinder.rpc [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:48 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Determined volume DB was empty at startup. Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG cinder.volume.manager [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86315) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 12:33:48 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 12:33:48 devstack cinder-volume[86315]: WARNING stevedore.named [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:33:48 devstack cinder-volume[86315]: WARNING castellan.key_manager [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:33:48 devstack cinder-volume[86315]: WARNING cinder.keymgr.conf_key_mgr [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:33:48 devstack cinder-volume[86315]: INFO cinder.volume.manager [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:48 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Starting 1 workers Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Started child 86538 {{(pid=86315) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Full set of CONF: {{(pid=86315) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] ******************************************************************************** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Configuration options gathered from: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] ================================================================================ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] allow_availability_zone_fallback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] allow_compression_on_image_upload = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] allowed_direct_url_schemes = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] api_rate_limit = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] auth_strategy = keystone {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86538]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_stats_polling_interval = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backup_api_class = cinder.backup.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backup_name_template = backup-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backup_use_same_host = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backup_use_temp_snapshot = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] chap_username = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_internal_tenant_project_id = f2f1cafdeca3485da2f0a8e36eb1b395 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_internal_tenant_user_id = 043baf2825754b0786b5b203c639aa9f {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cluster = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] compression_format = gzip {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] compute_api_class = cinder.compute.nova.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] config_dir = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] config_source = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] control_exchange = openstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] debug = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] default_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] default_group_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] default_volume_type = QuobyteHD {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_ssl_cert_verify = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] driver_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] enable_new_services = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] enable_unsupported_driver = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] enabled_backends = ['QuobyteHD'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] enforce_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_api_insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_api_ssl_compression = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_ca_certificates_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_catalog_info = image:glance:publicURL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_num_retries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance_request_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] graceful_shutdown_timeout = 5 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] group_api_class = cinder.group.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] host = devstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_compress_on_upload = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_conversion_address_space_limit = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_conversion_cpu_limit = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_conversion_disable = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_upload_use_cinder_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_upload_use_internal_tenant = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_volume_cache_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_volume_cache_max_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] image_volume_cache_max_size_gb = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] init_host_max_objects_retrieval = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] instance_format = [instance: %(uuid)s] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iscsi_target_flags = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iscsi_write_cache = on {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iser_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iser_ip_address = 192.168.122.202 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iser_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_color = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_config_append = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_options = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_rotate_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_rotate_interval_type = days {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] log_rotation_type = none {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86538]: INFO cinder.volume.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 12:33:48 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.remotefs [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86538) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] max_age = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] max_logfile_count = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] max_logfile_size_mb = 200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] max_over_subscription_ratio = 20.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] message_reap_interval = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] message_ttl = 2592000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] migration_create_volume_timeout_secs = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] monkey_patch = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] monkey_patch_modules = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] my_ip = 192.168.122.202 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] no_snapshot_gb_quota = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] num_iser_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] num_shell_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] num_volume_device_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] nvmeof_conn_info_version = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] nvmet_ns_id = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] nvmet_port_id = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_max_limit = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_ext_list = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_listen_port = 8776 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] osapi_volume_workers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] per_volume_size_limit = -1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] periodic_fuzzy_delay = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] periodic_interval = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] public_endpoint = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] publish_errors = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_backup_gigabytes = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_backups = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_gigabytes = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_groups = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_snapshots = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] quota_volumes = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] rate_limit_burst = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] rate_limit_except_level = CRITICAL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] rate_limit_interval = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] reinit_driver_count = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] report_discard_supported = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] report_interval = 120 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] reservation_clean_interval = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] reservation_expire = 86400 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] reserved_image_namespaces = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] reserved_percentage = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] rpc_response_timeout = 120 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] run_external_periodic_tasks = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] scst_target_driver = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_down_time = 720 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] shell_completion = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] snapshot_name_template = snapshot-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] state_path = /opt/stack/data/cinder {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] storage_availability_zone = nova {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] storage_protocol = iSCSI {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] syslog_log_facility = LOG_USER {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_helper = lioadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_ip_address = 192.168.122.202 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_protocol = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] target_secondary_ip_addresses = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] transport_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] until_refresh = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_chap_auth = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_default_quota_class = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_journal = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_json = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_stderr = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] use_syslog = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] verify_glance_signatures = enabled {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_api_class = cinder.volume.api.API {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_clear = zero {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_clear_size = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_copy_bps_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_dd_blocksize = 1M {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_name_template = volume-%s {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_service_inithost_offload = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volume_usage_audit_period = month {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] zoning_mode = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_concurrency.disable_process_locking = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.auth_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.include_service_catalog = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.interface = public {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcache_username = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.service_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.backend = dogpile.cache.null {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.backend_argument = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.backend_expiration_time = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.config_prefix = cache.oslo {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.debug_cache_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.enable_retry_client = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.enable_socket_keepalive = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.expiration_time = 600 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.hashclient_retry_attempts = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_dead_retry = 300 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_pool_maxsize = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_sasl_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.proxies = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.redis_db = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.redis_server = localhost:6379 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.retry_attempts = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.retry_delay = 0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.socket_keepalive_count = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.socket_keepalive_idle = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.socket_keepalive_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.socket_timeout = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.tls_allowed_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.tls_cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.tls_certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.tls_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.tls_keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cache.username = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] coordination.backend_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.asyncio_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.asyncio_slave_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.backend = sqlalchemy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.connection_debug = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.connection_parameters = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86538) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 12:33:48 devstack cinder-volume[86538]: WARNING cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 12:33:48 devstack cinder-volume[86538]: WARNING cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.connection_recycle_time = 3600 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.connection_trace = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.db_inc_retry_interval = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.db_max_retries = 20 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.db_max_retry_interval = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.db_retry_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.max_overflow = 50 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.max_pool_size = 5 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.max_retries = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.mysql_wsrep_sync_wait = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.pool_timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.retry_interval = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.slave_connection = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:48 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.sqlite_synchronous = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.synchronous_reader = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] database.use_db_reconnect = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_tracing.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.connection_string = messaging:// {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.es_doc_type = notification {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.es_scroll_size = 10000 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.es_scroll_time = 2m {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.filter_error_trace = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.hmac_keys = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.sentinel_service_name = mymaster {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.socket_timeout = 0.1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.trace_requests = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler.trace_sqlalchemy = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler_jaeger.process_tags = {} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler_jaeger.service_name_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] profiler_otlp.service_name_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.enforce_new_defaults = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.policy_default_rule = default {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.policy_file = policy.yaml {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.group = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.helper_command = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] privsep_osbrick.user = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.group = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.helper_command = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] cinder_sys_admin.user = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.send_service_user_token = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.tls_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] service_user.tls_min_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.auth_type = password {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.tls_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] glance.tls_min_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.chap_username = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.driver_use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.extra_capabilities = {} {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iscsi_target_flags = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iscsi_write_cache = on {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iser_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iser_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_host = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_login = admin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_mount_options = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_private_key = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_share_path = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.num_shell_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.quobyte_volume_url = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.report_discard_supported = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.reserved_percentage = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_helper = tgtadm {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_port = 3260 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack quobyte-client[86542]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 12:33:49 devstack quobyte-client[86542]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_protocol = iscsi {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.unique_fqdn_network = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.use_chap_auth = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_backend_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_clear = zero {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=86538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86538]: INFO cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 ... Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_clear_size = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab -c /etc/quobyte/client-cinder.cfg {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_reports.file_event_handler = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_reports.log_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.backend_availability_zone = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.backend_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.chap_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.chap_username = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.chiscsi_conf = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.disk_geometry = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_client_cert = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_data_namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.driver_use_ssl = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.extra_capabilities = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.filter_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.goodness_function = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iser_helper = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iser_ip_address = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iser_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.iser_target_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_host = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_login = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_mount_options = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_password = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_private_key = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_share_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab -c /etc/quobyte/client-cinder.cfg Sep 01 12:33:49 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_ssh_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.num_shell_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.nvmet_port_id = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.replication_device = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.report_discard_supported = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.reserved_percentage = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.scst_target_driver = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.storage_protocol = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_helper = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_ip_address = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_port = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_prefix = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_protocol = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.trace_flags = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.use_chap_auth = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_clear = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_clear_size = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] QuobyteHD.volumes_dir = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_notifications.driver = [] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_notifications.retry = -1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] key_manager.fixed_key = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.barbican_api_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.barbican_endpoint = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.barbican_endpoint_type = public {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.barbican_region_name = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.number_of_retries = 60 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.retry_delay = 1 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.send_service_user_token = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.tls_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.tls_min_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.verify_ssl = True {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican.verify_ssl_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.auth_section = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.auth_type = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.cafile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.certfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.collect_timing = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.insecure = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.keyfile = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.split_loggers = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.timeout = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.tls_ciphers = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] barbican_service_user.tls_min_version = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.approle_role_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.approle_secret_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.auth_method = approle {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.auth_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.kv_mountpoint = secret {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.kv_path = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.kv_version = 2 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.namespace = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.root_token_id = **** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.ssl_ca_crt_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.timeout = 60.0 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.token_file = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.token_role = None {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.use_ssl = False {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:49 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] ******************************************************************************** {{(pid=86315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 12:33:49 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:49 devstack cinder-volume[86538]: INFO cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 succeeded Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=86538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.405s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:49 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:33:49 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:49 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.255s {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:49 devstack cinder-volume[86538]: INFO cinder.volume.driver [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.volume.driver [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.979579925537, 'free_capacity_gb': 1773.979579925537, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86538) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG dbcounter [-] [86538] Writer thread running {{(pid=86538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.db.api [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Building query based on filter {{(pid=86538) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.image.image_utils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86538) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 12:33:49 devstack cinder-volume[86538]: INFO cinder.keymgr.migration [None req-b2eb640b-7707-4e01-a833-6ca415713160 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=86538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=86538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:33:49 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:49 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:33:49 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:50 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.239s {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG cinder.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Notifying Schedulers of capabilities ... {{(pid=86538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:33:50 devstack cinder-volume[86538]: INFO cinder.volume.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Driver initialization completed successfully. Sep 01 12:33:50 devstack cinder-volume[86538]: INFO cinder.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Initiating service 3 cleanup Sep 01 12:33:50 devstack cinder-volume[86538]: INFO cinder.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Service 3 cleanup completed. Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG cinder.service [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Creating RPC server for service cinder-volume {{(pid=86538) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG cinder.service [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86538) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 12:33:50 devstack cinder-volume[86538]: INFO cinder.volume.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=86538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=86538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:50 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:33:50 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:50 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:50 devstack cinder-volume[86538]: DEBUG oslo_concurrency.processutils [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.258s {{(pid=86538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:50 devstack cinder-volume[86538]: INFO cinder.volume.manager [None req-5fd2effa-8a72-4281-b8d1-23d6cc470ce1 None None] Driver post RPC initialization completed successfully. Sep 01 12:33:54 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Caught SIGTERM, stopping children Sep 01 12:33:54 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Acquiring lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:54 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Acquired lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:54 devstack cinder-volume[86315]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Releasing lock "singleton_lock" {{(pid=86315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:54 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Stop services. {{(pid=86315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 12:33:54 devstack cinder-volume[86315]: DEBUG oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Killing children. {{(pid=86315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 12:33:54 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Waiting on 1 children to exit Sep 01 12:33:54 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Acquiring lock "singleton_lock" {{(pid=86538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:54 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Acquired lock "singleton_lock" {{(pid=86538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:54 devstack cinder-volume[86538]: DEBUG oslo_concurrency.lockutils [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Releasing lock "singleton_lock" {{(pid=86538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:54 devstack cinder-volume[86538]: WARNING amqp [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:33:54 devstack cinder-volume[86538]: WARNING amqp [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 12:33:54 devstack cinder-volume[86315]: INFO oslo_service.backend._eventlet.service [None req-d0ad5c08-aef0-48c1-a428-b2c1d3fd3d63 None None] Child 86538 exited with status 0 Sep 01 12:33:55 devstack cinder-volume[86811]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 12:33:55 devstack cinder-volume[86811]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:33:55 devstack cinder-volume[86811]: we strongly recommend against using it for new projects. Sep 01 12:33:55 devstack cinder-volume[86811]: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:33:55 devstack cinder-volume[86811]: framework. For more detail see Sep 01 12:33:55 devstack cinder-volume[86811]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:33:55 devstack cinder-volume[86811]: import eventlet # noqa Sep 01 12:33:57 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 12:33:57 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 12:33:57 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 12:33:58 devstack cinder-volume[86811]: INFO dbcounter [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Registered counter for database cinder Sep 01 12:33:58 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:58 devstack cinder-volume[86811]: DEBUG dbcounter [-] [86811] Writer thread running {{(pid=86811) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:33:58 devstack cinder-volume[86811]: INFO cinder.rpc [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 12:33:58 devstack cinder-volume[86811]: INFO cinder.rpc [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 12:33:58 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:58 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Determined volume DB was empty at startup. Sep 01 12:33:58 devstack cinder-volume[86811]: DEBUG cinder.volume.manager [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86811) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 12:33:58 devstack cinder-volume[86811]: WARNING stevedore.named [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 12:33:58 devstack cinder-volume[86811]: WARNING castellan.key_manager [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:33:58 devstack cinder-volume[86811]: WARNING cinder.keymgr.conf_key_mgr [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 12:33:58 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:33:59 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Starting 1 workers Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Started child 87008 {{(pid=86811) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Full set of CONF: {{(pid=86811) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] Configuration options gathered from: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] ================================================================================ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] allow_availability_zone_fallback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] allow_compression_on_image_upload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] allowed_direct_url_schemes = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] api_rate_limit = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] auth_strategy = keystone {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[87008]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_stats_polling_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backup_api_class = cinder.backup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backup_name_template = backup-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backup_use_same_host = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_internal_tenant_project_id = f2f1cafdeca3485da2f0a8e36eb1b395 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_internal_tenant_user_id = 043baf2825754b0786b5b203c639aa9f {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cluster = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] compression_format = gzip {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] config_dir = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] config_source = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] control_exchange = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] debug = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] default_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] default_group_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] default_volume_type = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] enable_new_services = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_api_insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_api_ssl_compression = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_ca_certificates_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_num_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance_request_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] graceful_shutdown_timeout = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] group_api_class = cinder.group.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] host = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_compress_on_upload = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_conversion_address_space_limit = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_conversion_cpu_limit = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_conversion_disable = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] init_host_max_objects_retrieval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] instance_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iser_ip_address = 192.168.122.202 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_color = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_config_append = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_options = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_rotate_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_rotate_interval_type = days {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] log_rotation_type = none {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] max_age = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] max_logfile_count = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] max_logfile_size_mb = 200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] message_reap_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] message_ttl = 2592000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] monkey_patch = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] monkey_patch_modules = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] my_ip = 192.168.122.202 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] no_snapshot_gb_quota = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_max_limit = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_ext_list = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_listen_port = 8776 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] osapi_volume_workers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] per_volume_size_limit = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] periodic_fuzzy_delay = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] periodic_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] public_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] publish_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_backup_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_backups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_groups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_snapshots = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] quota_volumes = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] rate_limit_burst = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] rate_limit_except_level = CRITICAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] rate_limit_interval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] reinit_driver_count = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] report_interval = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] reservation_clean_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] reservation_expire = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] reserved_image_namespaces = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] rpc_response_timeout = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] run_external_periodic_tasks = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_down_time = 720 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] shell_completion = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] snapshot_name_template = snapshot-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] state_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] storage_availability_zone = nova {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] syslog_log_facility = LOG_USER {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_helper = lioadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_ip_address = 192.168.122.202 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] until_refresh = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_default_quota_class = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_journal = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_json = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_stderr = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] use_syslog = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] verify_glance_signatures = enabled {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_api_class = cinder.volume.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87008) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_name_template = volume-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_service_inithost_offload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volume_usage_audit_period = month {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] zoning_mode = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.auth_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.interface = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcache_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.service_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.backend = dogpile.cache.null {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.backend_argument = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.backend_expiration_time = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.config_prefix = cache.oslo {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.debug_cache_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.enable_retry_client = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.enable_socket_keepalive = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.expiration_time = 600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.proxies = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.redis_db = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.redis_server = localhost:6379 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.retry_delay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.socket_keepalive_count = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.socket_keepalive_idle = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.socket_keepalive_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.socket_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cache.username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] coordination.backend_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.asyncio_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.asyncio_slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.backend = sqlalchemy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.connection_debug = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.connection_parameters = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.connection_recycle_time = 3600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.connection_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.db_inc_retry_interval = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.db_max_retries = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.db_max_retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.db_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.max_overflow = 50 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.max_pool_size = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.max_retries = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.pool_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.sqlite_synchronous = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.synchronous_reader = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] database.use_db_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_tracing.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.connection_string = messaging:// {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.es_doc_type = notification {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.es_scroll_size = 10000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.es_scroll_time = 2m {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.filter_error_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.hmac_keys = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.socket_timeout = 0.1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.trace_requests = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler.trace_sqlalchemy = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler_jaeger.process_tags = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] profiler_otlp.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.policy_default_rule = default {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87008) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 12:33:59 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 12:33:59 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Running cmd (subprocess): mount.quobyte {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] privsep_osbrick.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] cinder_sys_admin.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.send_service_user_token = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] glance.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.extra_capabilities = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_host = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_login = admin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_private_key = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_share_path = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_reports.file_event_handler = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_reports.log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.chap_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.extra_capabilities = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iser_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iser_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iser_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_login = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_private_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_share_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack quobyte-client[87028]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.num_shell_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack quobyte-client[87028]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.report_discard_supported = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.reserved_percentage = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.scst_target_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.storage_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.use_chap_auth = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_clear = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_clear_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] QuobyteHD.volumes_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_notifications.driver = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] key_manager.fixed_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.barbican_api_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.barbican_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.barbican_endpoint_type = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.barbican_region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.number_of_retries = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.retry_delay = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.send_service_user_token = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.verify_ssl = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican.verify_ssl_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.auth_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] barbican_service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.approle_role_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.approle_secret_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.auth_method = approle {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.auth_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.kv_mountpoint = secret {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.kv_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.kv_version = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.root_token_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:33:59 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.token_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.token_role = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 12:33:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-f033edd9-edbd-43c2-bf39-dd8b390380d1 None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 12:33:59 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.587s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:33:59 devstack cinder-volume[87008]: INFO cinder.volume.driver [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Driver hasn't implemented _init_vendor_properties() Sep 01 12:33:59 devstack cinder-volume[87008]: DEBUG cinder.volume.driver [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9766807556152, 'free_capacity_gb': 1773.9766807556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87008) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writer thread running {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.db.api [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Building query based on filter {{(pid=87008) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87008) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:34:00 devstack cinder-volume[87008]: INFO cinder.keymgr.migration [None req-b69ee289-68c9-4d15-86b7-9b2eae8a5e9f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 12:34:00 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:34:00 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:34:00 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.573s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:34:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Driver initialization completed successfully. Sep 01 12:34:00 devstack cinder-volume[87008]: INFO cinder.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Initiating service 3 cleanup Sep 01 12:34:00 devstack cinder-volume[87008]: INFO cinder.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Service 3 cleanup completed. Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.service [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Creating RPC server for service cinder-volume {{(pid=87008) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 12:34:00 devstack cinder-volume[87008]: DEBUG cinder.service [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87008) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 12:34:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:34:01 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:34:01 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:34:01 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:34:01 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:34:01 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:34:01 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.372s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:34:01 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-86e18281-6b3e-4149-bd05-9ada357509f7 None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:34:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bcf6c20f-add9-45eb-9988-d00b3e61128f None None] Driver post RPC initialization completed successfully. Sep 01 12:34:09 devstack cinder-volume[86811]: DEBUG dbcounter [-] [86811] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86811) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:34:10 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:34:11 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:34:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:34:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 6 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:34:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Flow 'volume_create_manager' (c7170521-afd5-411f-804a-aa47507ad11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d2a0f1-1cb9-4e83-a45c-35a955e36d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d2a0f1-1cb9-4e83-a45c-35a955e36d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1855396890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8229fdde-37b7-4ba5-ad93-79dcad14fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4df8e4eaf34f14877dcb2e4f583a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:02Z,use_quota=True,user_id='3557b626c653401cb6e3a3d6444b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970fd482-d449-43a4-a2f7-ae0a7e10441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970fd482-d449-43a4-a2f7-ae0a7e10441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f80164-c107-465e-8e8b-af9e180c7611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f80164-c107-465e-8e8b-af9e180c7611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8229fdde-37b7-4ba5-ad93-79dcad14fb70', 'volume_name': 'volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa413e5-9106-43dc-a6d0-172ee5525c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa413e5-9106-43dc-a6d0-172ee5525c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b9d5a-47a7-46a2-9630-87c81cb4ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Volume 8229fdde-37b7-4ba5-ad93-79dcad14fb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70', 'volume_size': 1} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1855396890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8229fdde-37b7-4ba5-ad93-79dcad14fb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db4df8e4eaf34f14877dcb2e4f583a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:02Z,use_quota=True,user_id='3557b626c653401cb6e3a3d6444b0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Creating volume 8229fdde-37b7-4ba5-ad93-79dcad14fb70 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:35:01 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:35:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:01 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 1073741824 Sep 01 12:35:01 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:02 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 1073741824" returned: 0 in 0.668s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:02 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 Sep 01 12:35:02 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:02 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70" returned: 0 in 0.340s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b9d5a-47a7-46a2-9630-87c81cb4ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7381ae9-1a1b-45de-86b7-497414f94901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:03 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Volume volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 (8229fdde-37b7-4ba5-ad93-79dcad14fb70): created successfully Sep 01 12:35:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7381ae9-1a1b-45de-86b7-497414f94901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Flow 'volume_create_manager' (c7170521-afd5-411f-804a-aa47507ad11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cf34274d-7f73-4f13-8945-9cf7afc26c90 tempest-TaggedAttachmentsTest-455342644 None] Created volume successfully. Sep 01 12:35:12 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:35:13 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:26 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:35:26 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:27 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.642s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:35:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:35:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 6 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:35:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Flow 'volume_create_manager' (a04df72e-e473-454a-bb99-8bfcbfd925ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21de568-ecf3-455b-9bda-46dbdf73ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21de568-ecf3-455b-9bda-46dbdf73ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2111555636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c64f980-523c-4edf-9402-1a2987995bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfbff60c4ba4cfdab4ca07860b5c967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:34Z,use_quota=True,user_id='8aeb4b8b213344aeb82b989d92ef6e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9d15d-ba68-4146-8899-1c45d18fa5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9d15d-ba68-4146-8899-1c45d18fa5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbda25c-d9e6-4d96-85b7-8221d6cee875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbda25c-d9e6-4d96-85b7-8221d6cee875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c64f980-523c-4edf-9402-1a2987995bb9', 'volume_name': 'volume-4c64f980-523c-4edf-9402-1a2987995bb9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c8d7fc-e6e9-4d9d-8907-bcb869df1c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c8d7fc-e6e9-4d9d-8907-bcb869df1c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcca859-c0ff-40b3-852b-d6031cb2df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Volume 4c64f980-523c-4edf-9402-1a2987995bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c64f980-523c-4edf-9402-1a2987995bb9', 'volume_size': 1} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2111555636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c64f980-523c-4edf-9402-1a2987995bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfbff60c4ba4cfdab4ca07860b5c967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:34Z,use_quota=True,user_id='8aeb4b8b213344aeb82b989d92ef6e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Creating volume 4c64f980-523c-4edf-9402-1a2987995bb9 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:35:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:35:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:34 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 1073741824 Sep 01 12:35:34 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:35 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 1073741824" returned: 0 in 1.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:35 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 Sep 01 12:35:35 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:36 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9" returned: 0 in 0.771s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcca859-c0ff-40b3-852b-d6031cb2df57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c64f980-523c-4edf-9402-1a2987995bb9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988d0998-bf57-46cd-b905-cf12a77fd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Volume volume-4c64f980-523c-4edf-9402-1a2987995bb9 (4c64f980-523c-4edf-9402-1a2987995bb9): created successfully Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988d0998-bf57-46cd-b905-cf12a77fd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Flow 'volume_create_manager' (a04df72e-e473-454a-bb99-8bfcbfd925ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d5abab23-0eac-4787-8492-d286140f4982 tempest-VolumesAdminNegativeTest-1133414967 None] Created volume successfully. Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Acquiring lock "cinder-4c64f980-523c-4edf-9402-1a2987995bb9-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "cinder-4c64f980-523c-4edf-9402-1a2987995bb9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Acquiring lock "cinder-quobyte-4c64f980-523c-4edf-9402-1a2987995bb9" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "cinder-quobyte-4c64f980-523c-4edf-9402-1a2987995bb9" acquired by "delete_volume" :: waited 0.051s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:38 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8_a6xd1i/privsep.sock'] Sep 01 12:35:38 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8_a6xd1i/privsep.sock Sep 01 12:35:38 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Flow 'volume_create_manager' (d1fc9e67-ada2-4acb-b9f6-1f005d943ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b145935-ff3b-4e01-a2e0-71bf95fc0bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b145935-ff3b-4e01-a2e0-71bf95fc0bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834874766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fdccbe24ebf44a5b4295f7f6b41ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:38Z,use_quota=True,user_id='6564b76b201c4cdebdb20670caedad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0345fa-22f6-42e8-bbd1-3715163c123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0345fa-22f6-42e8-bbd1-3715163c123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2de5046-1896-439a-83b5-800c2aff339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2de5046-1896-439a-83b5-800c2aff339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e', 'volume_name': 'volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b1ac1d-c0b7-488a-aa59-6f80d66f4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b1ac1d-c0b7-488a-aa59-6f80d66f4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640c8298-0d96-442a-8be7-562917873cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:38 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Volume a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e', 'volume_size': 1} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834874766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fdccbe24ebf44a5b4295f7f6b41ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:38Z,use_quota=True,user_id='6564b76b201c4cdebdb20670caedad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Creating volume a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:35:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:35:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:38 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e 1073741824 Sep 01 12:35:38 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:39 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e 1073741824" returned: 0 in 0.917s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:39 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e Sep 01 12:35:39 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:40 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640c8298-0d96-442a-8be7-562917873cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec52dec-6ddc-452e-b4fe-51a5dd1fe566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Volume volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e (a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e): created successfully Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec52dec-6ddc-452e-b4fe-51a5dd1fe566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Flow 'volume_create_manager' (d1fc9e67-ada2-4acb-b9f6-1f005d943ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 12:35:40 devstack cinder-volume[87008]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 12:35:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-135d7265-74d1-40db-9249-6645f4d262eb tempest-ServersNegativeTestJSON-1432527413 None] Created volume successfully. Sep 01 12:35:40 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:40 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Spawned new privsep daemon via rootwrap Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Accepted privsep connection to /tmp/tmp8_a6xd1i/privsep.sock {{(pid=87008) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 12:35:40 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 12:35:40 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 12:35:40 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 12:35:40 devstack cinder-volume[87008]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88456 Sep 01 12:35:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb56605f-fc66-445b-91c3-503d8d21af92]: (2,) {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:35:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c87df6-1446-4aee-8721-0107e2bfede7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:35:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:41 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 Sep 01 12:35:41 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:41 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9" returned: 0 in 0.805s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:41 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9 Sep 01 12:35:41 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:42 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c64f980-523c-4edf-9402-1a2987995bb9" returned: 0 in 0.652s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "cinder-quobyte-4c64f980-523c-4edf-9402-1a2987995bb9" released by "delete_volume" :: held 3.967s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:35:42 devstack cinder-volume[87008]: WARNING cinder.quota [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:35:42 devstack cinder-volume[87008]: WARNING cinder.quota [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:35:42 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Created reservations ['832b96d9-b7e6-4dfb-89ed-06ee0001e9b0', '782c22ed-0b38-4d83-9bc8-2e561e21b7b5', '4def06a5-db51-4ed2-ab55-63394c77577f', '78a52f0a-7ae6-4589-b130-f081715cd09d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:43 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:35:43 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:43 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.753s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:35:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Deleted volume successfully. Sep 01 12:35:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9da49b39-cb55-407b-8ca3-58e271114813 tempest-VolumesAdminNegativeTest-1133414967 None] Lock "cinder-4c64f980-523c-4edf-9402-1a2987995bb9-delete_volume" released by "delete_volume" :: held 5.490s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Flow 'volume_create_manager' (b4491443-8807-456f-be38-131f0648f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e913f3d-4d03-4ee1-9649-a93345f400d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e913f3d-4d03-4ee1-9649-a93345f400d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2036793193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125e56ab-3e1c-4758-915d-8390e9128912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fdccbe24ebf44a5b4295f7f6b41ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:45Z,use_quota=True,user_id='6564b76b201c4cdebdb20670caedad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c887425-37d4-403f-99a5-1348fba2577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c887425-37d4-403f-99a5-1348fba2577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5b69c-a814-4925-ae20-843cbaec6c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5b69c-a814-4925-ae20-843cbaec6c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125e56ab-3e1c-4758-915d-8390e9128912', 'volume_name': 'volume-125e56ab-3e1c-4758-915d-8390e9128912', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e35227-a611-4cf7-9634-147aa4ffbd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e35227-a611-4cf7-9634-147aa4ffbd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24d99ab-dbf3-4363-b592-395fc4b97e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:45 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Volume 125e56ab-3e1c-4758-915d-8390e9128912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125e56ab-3e1c-4758-915d-8390e9128912', 'volume_size': 1} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2036793193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125e56ab-3e1c-4758-915d-8390e9128912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fdccbe24ebf44a5b4295f7f6b41ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:35:45Z,use_quota=True,user_id='6564b76b201c4cdebdb20670caedad4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Creating volume 125e56ab-3e1c-4758-915d-8390e9128912 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:35:45 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:35:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:45 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 1073741824 Sep 01 12:35:45 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:46 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 1073741824" returned: 0 in 0.776s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:46 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 Sep 01 12:35:46 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:46 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912" returned: 0 in 0.309s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24d99ab-dbf3-4363-b592-395fc4b97e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125e56ab-3e1c-4758-915d-8390e9128912', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0be2bcc-b41e-416a-810d-1ba009501153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:35:46 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Volume volume-125e56ab-3e1c-4758-915d-8390e9128912 (125e56ab-3e1c-4758-915d-8390e9128912): created successfully Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0be2bcc-b41e-416a-810d-1ba009501153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:35:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Flow 'volume_create_manager' (b4491443-8807-456f-be38-131f0648f835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:35:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4c6a6ca9-0ec3-43ad-b1aa-e2982406fc18 tempest-ServersNegativeTestJSON-1432527413 None] Created volume successfully. Sep 01 12:35:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "cinder-125e56ab-3e1c-4758-915d-8390e9128912-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-125e56ab-3e1c-4758-915d-8390e9128912-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "cinder-quobyte-125e56ab-3e1c-4758-915d-8390e9128912" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-quobyte-125e56ab-3e1c-4758-915d-8390e9128912" acquired by "delete_volume" :: waited 0.051s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9a5f6-f610-44ee-9515-25032241c041]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:50 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 Sep 01 12:35:50 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:50 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912" returned: 0 in 0.499s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:50 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912 Sep 01 12:35:50 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:51 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-125e56ab-3e1c-4758-915d-8390e9128912" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-quobyte-125e56ab-3e1c-4758-915d-8390e9128912" released by "delete_volume" :: held 0.991s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Created reservations ['db9d3172-0c47-46d5-bb99-2ff99b14ea1d', '3dab7c2b-6cd9-497a-a4f0-08dc8f9c60cc', 'fa59e14f-13fd-4949-a792-91111db1fe6d', '7af01b84-9c94-4c4c-b8b3-16cf0e51ccc3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:51 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:35:51 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:51 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.284s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:35:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Deleted volume successfully. Sep 01 12:35:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-95585e8e-7d02-46cb-bdf7-0adf2e68c852 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-125e56ab-3e1c-4758-915d-8390e9128912-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "cinder-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "cinder-quobyte-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-quobyte-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8861a-b883-4532-8dce-14b1d652cd20]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:35:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:52 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e Sep 01 12:35:52 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:53 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" returned: 0 in 0.667s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:53 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e Sep 01 12:35:53 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:53 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" returned: 0 in 0.372s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-quobyte-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e" released by "delete_volume" :: held 1.121s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Created reservations ['de2697c0-51b0-4ad8-b05f-061316af39d7', '8e964a5f-0ccd-450d-a66d-774e37922c0c', '9c7e3696-6515-48a9-bb59-b2617dc81a97', '465189df-92e5-4f1c-82d4-1da90e054063'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:35:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:35:53 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:35:53 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:35:54 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Sep 01 12:35:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.332s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:35:54 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:35:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Deleted volume successfully. Sep 01 12:35:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d365ce4c-24d1-4c9f-9576-d4ec8f84b503 tempest-ServersNegativeTestJSON-1432527413 None] Lock "cinder-a8870bdf-5d57-439c-abb9-9c3a2f8e2f2e-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:11 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:36:11 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=19,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:36:15 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:36:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Flow 'volume_create_manager' (1083d65e-0d4a-4224-b081-a626c8e1af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fa3390-33ba-45e9-acc5-042f601d261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fa3390-33ba-45e9-acc5-042f601d261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-67514273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd21c4f-869f-4e8b-81f2-bd096f97cc93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94092d321e9d4d0c936e7c3c99d056f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:16Z,use_quota=True,user_id='9112ba61052841e1b62946ca83c15a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f2a6d8-fbf8-4548-8824-c52f8dd1a739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f2a6d8-fbf8-4548-8824-c52f8dd1a739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2c05fb-5ea7-471b-a8d3-6a493bd7333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2c05fb-5ea7-471b-a8d3-6a493bd7333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd21c4f-869f-4e8b-81f2-bd096f97cc93', 'volume_name': 'volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae9fbdf-b12c-4700-be4b-ae7dbaec0302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae9fbdf-b12c-4700-be4b-ae7dbaec0302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0355d5-df02-4f34-a647-ed2a8e3ec486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Volume 4cd21c4f-869f-4e8b-81f2-bd096f97cc93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93', 'volume_size': 1} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-67514273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd21c4f-869f-4e8b-81f2-bd096f97cc93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94092d321e9d4d0c936e7c3c99d056f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:16Z,use_quota=True,user_id='9112ba61052841e1b62946ca83c15a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Creating volume 4cd21c4f-869f-4e8b-81f2-bd096f97cc93 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:36:16 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:36:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:16 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 1073741824 Sep 01 12:36:16 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:17 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 1073741824" returned: 0 in 1.305s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:17 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 Sep 01 12:36:17 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:18 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" returned: 0 in 0.690s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0355d5-df02-4f34-a647-ed2a8e3ec486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6af11a-445b-43a6-890f-b4cedd3cb56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Volume volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 (4cd21c4f-869f-4e8b-81f2-bd096f97cc93): created successfully Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6af11a-445b-43a6-890f-b4cedd3cb56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Flow 'volume_create_manager' (1083d65e-0d4a-4224-b081-a626c8e1af3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-2f1740f0-3203-44b3-9679-d766e22b2e38 req-2d696f61-6331-40c2-b3e2-5b21c472054a tempest-VolumesGetTestJSON-1647491219 None] Created volume successfully. Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Acquiring lock "cinder-4cd21c4f-869f-4e8b-81f2-bd096f97cc93-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "cinder-4cd21c4f-869f-4e8b-81f2-bd096f97cc93-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Acquiring lock "cinder-quobyte-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "cinder-quobyte-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" acquired by "delete_volume" :: waited 0.051s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eeb588-4f2c-49c2-84ea-1279ae5b7999]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:20 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 Sep 01 12:36:20 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:20 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" returned: 0 in 0.853s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:20 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93 Sep 01 12:36:20 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:21 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" returned: 0 in 0.517s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "cinder-quobyte-4cd21c4f-869f-4e8b-81f2-bd096f97cc93" released by "delete_volume" :: held 1.471s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG cinder.quota [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Created reservations ['1927a0d4-036d-48bb-910b-408f75a5fdd1', '4e7c6373-11e6-4aca-ad09-5b343eb495c2', 'df286eec-598a-45d1-a2d5-ebcfa3dc2fa3', '05f3d21d-4181-4a09-8445-d087ce9e599a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:21 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:36:21 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:22 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.345s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG cinder.manager [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:36:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Deleted volume successfully. Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-73b1bb96-ac1a-4b9d-9ddc-b16e06a3d705 req-5d521089-d92f-4396-80c1-754e190177cb tempest-VolumesGetTestJSON-1647491219 None] Lock "cinder-4cd21c4f-869f-4e8b-81f2-bd096f97cc93-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:22 devstack cinder-volume[87008]: WARNING py.warnings [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 01 12:36:22 devstack cinder-volume[87008]: .first() Sep 01 12:36:22 devstack cinder-volume[87008]: Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6f2aac9-6a29-4846-94a1-0e3cb63b59d8', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:36:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-777fa7e8-48e8-4903-a8c9-0556769b7358 req-05c7ea29-c875-4f97-b694-a1dd3f6b5c9f tempest-TaggedAttachmentsTest-455342644 None] attachment_update completed successfully. Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Flow 'volume_create_manager' (fbbcda2a-4469-45b7-ae8b-0b95821d6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f6ffde-8c14-46e8-8701-878e28b125d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f6ffde-8c14-46e8-8701-878e28b125d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1540506308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9718fb8d-269a-4d8e-8299-dc1610a8c9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58908bac8278483d99b9b38902790fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:24Z,use_quota=True,user_id='82f51968691f43efbb9cc24ea1c2f1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e98661-79f6-455e-8953-3f72a1169942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e98661-79f6-455e-8953-3f72a1169942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c72b78e-0e3e-48ff-8305-1275e8513d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c72b78e-0e3e-48ff-8305-1275e8513d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9718fb8d-269a-4d8e-8299-dc1610a8c9e2', 'volume_name': 'volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2a415a-f6ac-4faa-a1c6-1cbf96f44805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2a415a-f6ac-4faa-a1c6-1cbf96f44805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3504b16c-e963-4143-8aee-66e327b0827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Volume 9718fb8d-269a-4d8e-8299-dc1610a8c9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2', 'volume_size': 1} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1540506308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9718fb8d-269a-4d8e-8299-dc1610a8c9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58908bac8278483d99b9b38902790fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:24Z,use_quota=True,user_id='82f51968691f43efbb9cc24ea1c2f1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Creating volume 9718fb8d-269a-4d8e-8299-dc1610a8c9e2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:36:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:36:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:24 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 1073741824 Sep 01 12:36:24 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:25 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 1073741824" returned: 0 in 0.867s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:25 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 Sep 01 12:36:25 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:25 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" returned: 0 in 0.498s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3504b16c-e963-4143-8aee-66e327b0827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961000eb-91fb-4bf9-ba95-17641173f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:26 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Volume volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 (9718fb8d-269a-4d8e-8299-dc1610a8c9e2): created successfully Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961000eb-91fb-4bf9-ba95-17641173f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Flow 'volume_create_manager' (fbbcda2a-4469-45b7-ae8b-0b95821d6d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7bb48a3c-e4d8-4bea-aa55-7497af553ff3 tempest-ServerRescueNegativeTestJSON-1344271262 None] Created volume successfully. Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:26 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:36:26 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:27 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.540s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:36:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-01ab4f62-313b-4de9-add0-2c32e1da51ca req-107cdf1e-848f-4516-bf8d-843707ec5251 tempest-TaggedAttachmentsTest-455342644 None] Terminate volume connection completed successfully. Sep 01 12:36:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-01ab4f62-313b-4de9-add0-2c32e1da51ca req-107cdf1e-848f-4516-bf8d-843707ec5251 tempest-TaggedAttachmentsTest-455342644 None] Deleting attachment f6f2aac9-6a29-4846-94a1-0e3cb63b59d8. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:36:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-33c72346-3911-4611-bb88-28f007402696 tempest-GroupSnapshotsV319Test-1718234700 None] Group tempest-GroupSnapshotsV319Test-Group-548056638: creating Sep 01 12:36:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-33c72346-3911-4611-bb88-28f007402696 tempest-GroupSnapshotsV319Test-1718234700 None] Group tempest-GroupSnapshotsV319Test-Group-548056638: created successfully Sep 01 12:36:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-33c72346-3911-4611-bb88-28f007402696 tempest-GroupSnapshotsV319Test-1718234700 None] Create group completed successfully. Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Flow 'volume_create_manager' (275011f7-fda3-4b42-a37f-9738feb070b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7e5db-8aa9-43c0-b65c-726a1d41c03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e7e5db-8aa9-43c0-b65c-726a1d41c03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35791792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=883547ca-efd2-4044-815c-47a421540b34,host='devstack@QuobyteHD#QuobyteHD',id=250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f70d66702774f98830b4f79fff3530a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:35Z,use_quota=True,user_id='50bd38208b89477b81dd39bd37c95cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a892e356-330b-4bb7-817d-0c7f56c9fcd8),volume_type_id=a892e356-330b-4bb7-817d-0c7f56c9fcd8)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdafc274-b1dc-4f37-9ae1-49006be73f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdafc274-b1dc-4f37-9ae1-49006be73f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80687a7-74f0-4bf5-a62c-eb8d370b406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80687a7-74f0-4bf5-a62c-eb8d370b406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad', 'volume_name': 'volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b6a82c-890e-4649-9b8b-483b08b3acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b6a82c-890e-4649-9b8b-483b08b3acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3080e65-8a99-4c8f-93d0-1ec8b747dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Volume 250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad', 'volume_size': 1} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=883547ca-efd2-4044-815c-47a421540b34,created_at=2026-09-01T10:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35791792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=883547ca-efd2-4044-815c-47a421540b34,host='devstack@QuobyteHD#QuobyteHD',id=250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f70d66702774f98830b4f79fff3530a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:36:35Z,use_quota=True,user_id='50bd38208b89477b81dd39bd37c95cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a892e356-330b-4bb7-817d-0c7f56c9fcd8),volume_type_id=a892e356-330b-4bb7-817d-0c7f56c9fcd8)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Creating volume 250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:36:35 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:35 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad 1073741824 Sep 01 12:36:35 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:35 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad 1073741824" returned: 0 in 0.823s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:36 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad Sep 01 12:36:36 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:36 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" returned: 0 in 0.788s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3080e65-8a99-4c8f-93d0-1ec8b747dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238c23b4-84e8-4471-ba16-e84f5d81fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:36:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Volume volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad (250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad): created successfully Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238c23b4-84e8-4471-ba16-e84f5d81fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:36:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Flow 'volume_create_manager' (275011f7-fda3-4b42-a37f-9738feb070b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:36:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3e9d6e8d-4b4b-4dae-92b1-31c6c4333631 tempest-GroupSnapshotsV319Test-1718234700 None] Created volume successfully. Sep 01 12:36:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] GroupSnapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: creating. Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Group snapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: creating. {{(pid=87008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Creating offline snapshot 764e27f7-7301-4a13-b6db-54f6cc0b1ab4 of volume 250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65be92a-a7d0-40ec-8671-75e3223c8d29]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:38 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad Sep 01 12:36:38 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:38 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" returned: 0 in 0.635s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:38 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 1G Sep 01 12:36:38 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:39 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 1G" returned: 0 in 0.707s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:39 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 Sep 01 12:36:39 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:40 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4" returned: 0 in 0.436s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:40 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:36:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:40 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 Sep 01 12:36:40 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:40 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:40 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info Sep 01 12:36:40 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:41 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info" returned: 0 in 0.483s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:41 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:36:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:41 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info Sep 01 12:36:41 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:41 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.info" returned: 0 in 0.478s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.363s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e1f3805a-921f-4270-8967-5d33d6f2790c tempest-GroupSnapshotsV319Test-1718234700 None] group_snapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: created successfully Sep 01 12:36:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] group_snapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: deleting Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] group_snapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: deleting {{(pid=87008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "cinder-quobyte-764e27f7-7301-4a13-b6db-54f6cc0b1ab4" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-764e27f7-7301-4a13-b6db-54f6cc0b1ab4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Deleting offline snapshot 764e27f7-7301-4a13-b6db-54f6cc0b1ab4 of volume 250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] snapshot_file for this snap is: volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b1ae9-6420-45e0-9c8a-4b2073419475]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:43 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 Sep 01 12:36:43 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:44 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4" returned: 0 in 0.754s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:36:44 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18c0f2-c66f-4e8f-b7e4-47b9521e094e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:44 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad Sep 01 12:36:44 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:45 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" returned: 0 in 0.706s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:45 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 Sep 01 12:36:45 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Acquiring lock "cinder-9718fb8d-269a-4d8e-8299-dc1610a8c9e2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "cinder-9718fb8d-269a-4d8e-8299-dc1610a8c9e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Acquiring lock "cinder-quobyte-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "cinder-quobyte-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[24655537-d3a9-4a5a-81bd-215d6b999f0c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:45 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 Sep 01 12:36:45 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:45 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4" returned: 0 in 0.796s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:46 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4 Sep 01 12:36:46 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:46 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" returned: 0 in 0.712s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:46 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2 Sep 01 12:36:46 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:46 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad.764e27f7-7301-4a13-b6db-54f6cc0b1ab4" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-764e27f7-7301-4a13-b6db-54f6cc0b1ab4" released by "_delete_snapshot" :: held 2.930s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" released by "delete_snapshot" :: held 2.980s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:46 devstack cinder-volume[87008]: WARNING cinder.quota [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1600116193 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1600116193, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:36:46 devstack cinder-volume[87008]: WARNING cinder.quota [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1600116193 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1600116193, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] Created reservations ['d9e10df2-2519-4bd3-ab95-c828013eb8fa', '35457829-8887-4ee3-b710-6f04d9dcc98a', '6db2d9e1-d4b5-497d-8995-064da162d3b3', 'd4087d74-d0fe-45b6-8cfc-12e179be395a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5a579f85-ec34-4c51-8a42-d2f7ae43e259 tempest-GroupSnapshotsV319Test-1718234700 None] group_snapshot a6b7bc3a-8e61-4e4d-8b89-639985965524: deleted successfully Sep 01 12:36:46 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" returned: 0 in 0.510s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "cinder-quobyte-9718fb8d-269a-4d8e-8299-dc1610a8c9e2" released by "delete_volume" :: held 1.312s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Created reservations ['398a1da6-3a14-4b54-a7cd-7f14f73e46b0', '08f5349a-9cd0-499e-829f-d3af221d5b6f', '290448da-5257-4deb-9390-255852adead0', 'd397fcc0-a695-48ed-87f6-985550431d9b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:47 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:36:47 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "cinder-8229fdde-37b7-4ba5-ad93-79dcad14fb70-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "cinder-8229fdde-37b7-4ba5-ad93-79dcad14fb70-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:47 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "cinder-quobyte-8229fdde-37b7-4ba5-ad93-79dcad14fb70" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.592s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:36:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Deleted volume successfully. Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "cinder-quobyte-8229fdde-37b7-4ba5-ad93-79dcad14fb70" acquired by "delete_volume" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fbf4b7-fdd7-4cf7-b346-0ad33a879523]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19661cde-c7d7-4307-9a8f-42203764e625 tempest-ServerRescueNegativeTestJSON-1344271262 None] Lock "cinder-9718fb8d-269a-4d8e-8299-dc1610a8c9e2-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c699e-aa12-4ba7-8b43-741da0ef7d50]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:36:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:47 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 Sep 01 12:36:47 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:48 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad Sep 01 12:36:48 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:48 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70" returned: 0 in 1.009s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:48 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70 Sep 01 12:36:48 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:48 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" returned: 0 in 0.905s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:48 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad Sep 01 12:36:48 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:49 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8229fdde-37b7-4ba5-ad93-79dcad14fb70" returned: 0 in 0.380s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "cinder-quobyte-8229fdde-37b7-4ba5-ad93-79dcad14fb70" released by "delete_volume" :: held 1.476s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:49 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" returned: 0 in 0.529s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Lock "cinder-quobyte-250c73d6-e2c1-4fad-b51e-5cd3fbe6ecad" released by "delete_volume" :: held 1.536s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Created reservations ['b5162a60-36d7-4666-8fe4-cad252c913ba', '6f62500c-9a70-44e1-9863-14ef8361d6d1', 'ead7b863-6ba9-406b-b4d9-89301e4e87db', '759ccd94-f871-431e-9629-fdb5ef539265'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Created reservations ['291026da-111d-4a73-9f5a-9a9338b611b2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:49 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:36:49 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:49 devstack cinder-volume[87008]: WARNING cinder.quota [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1600116193 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1600116193, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:36:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Created reservations ['69cb49a0-e635-4bc4-b3c5-9d8cfc2c41c6', 'c80c7dbc-5ce1-478a-ba9b-a5b235502587', '4aa2ee0f-bae5-41fd-b276-103b54c42eb4', '110d4a2c-d669-4a51-a1b8-c6f5c923ffa7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:36:50 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:36:50 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:36:50 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.816s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:36:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Deleted volume successfully. Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-078f0dda-b548-4356-b9c9-b8c0a0994544 tempest-TaggedAttachmentsTest-455342644 None] Lock "cinder-8229fdde-37b7-4ba5-ad93-79dcad14fb70-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:36:50 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.592s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:36:50 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:36:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-67badd1a-05e6-4b2c-9d13-e29aef3ea89b tempest-GroupSnapshotsV319Test-1718234700 None] Delete group completed successfully. Sep 01 12:37:00 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=57,cinder:UPDATE=56,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:37:00 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=53,cinder:SELECT=45,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Flow 'volume_create_manager' (1a0ddcfa-4840-4a34-8867-2779be756bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87231bff-a285-496e-b7d9-75d8dc00b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87231bff-a285-496e-b7d9-75d8dc00b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1294679461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f8f145-73bc-4797-9931-d922b8db8447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a879bcc090544295b7e0120d9873f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:37:07Z,use_quota=True,user_id='773d714700994a7ca5e96a43cab6c202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec8531f-eb2e-4521-8126-14ec6f4d9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec8531f-eb2e-4521-8126-14ec6f4d9088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2edc5e-29bd-49aa-9dae-58014f53a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2edc5e-29bd-49aa-9dae-58014f53a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f8f145-73bc-4797-9931-d922b8db8447', 'volume_name': 'volume-68f8f145-73bc-4797-9931-d922b8db8447', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3aa4362-59e6-4440-b0e5-eb05cd7c27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3aa4362-59e6-4440-b0e5-eb05cd7c27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20339939-a900-4924-9242-5ee34089c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Volume 68f8f145-73bc-4797-9931-d922b8db8447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f8f145-73bc-4797-9931-d922b8db8447', 'volume_size': 1} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1294679461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f8f145-73bc-4797-9931-d922b8db8447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a879bcc090544295b7e0120d9873f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:37:07Z,use_quota=True,user_id='773d714700994a7ca5e96a43cab6c202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Creating volume 68f8f145-73bc-4797-9931-d922b8db8447 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:37:07 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:37:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:07 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 1073741824 Sep 01 12:37:07 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:08 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 1073741824" returned: 0 in 0.485s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:08 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 Sep 01 12:37:08 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:08 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447" returned: 0 in 0.308s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:37:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20339939-a900-4924-9242-5ee34089c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f8f145-73bc-4797-9931-d922b8db8447', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fb2c3f-c91f-4c14-927e-b29b80c1c664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Volume volume-68f8f145-73bc-4797-9931-d922b8db8447 (68f8f145-73bc-4797-9931-d922b8db8447): created successfully Sep 01 12:37:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fb2c3f-c91f-4c14-927e-b29b80c1c664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Flow 'volume_create_manager' (1a0ddcfa-4840-4a34-8867-2779be756bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:37:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-84b86e03-4c72-4d3a-8a19-f0544eca7921 tempest-DeleteServersTestJSON-1841148469 None] Created volume successfully. Sep 01 12:37:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8a0e130f-1de7-4f3b-8c12-9e0dcb117dc0 req-51aee4ad-15f6-4c9e-b1ae-2de9cacc763b tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8a0e130f-1de7-4f3b-8c12-9e0dcb117dc0 req-51aee4ad-15f6-4c9e-b1ae-2de9cacc763b tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8a0e130f-1de7-4f3b-8c12-9e0dcb117dc0 req-51aee4ad-15f6-4c9e-b1ae-2de9cacc763b tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-8a0e130f-1de7-4f3b-8c12-9e0dcb117dc0 req-51aee4ad-15f6-4c9e-b1ae-2de9cacc763b tempest-DeleteServersTestJSON-1841148469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-68f8f145-73bc-4797-9931-d922b8db8447', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3ce9e28-59df-4a7c-b819-6809cace20ed', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:37:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-8a0e130f-1de7-4f3b-8c12-9e0dcb117dc0 req-51aee4ad-15f6-4c9e-b1ae-2de9cacc763b tempest-DeleteServersTestJSON-1841148469 None] attachment_update completed successfully. Sep 01 12:37:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9058a413-d203-4667-bb2b-77b5df417e7d tempest-GroupsV314Test-1639539892 None] Group tempest-GroupsV314Test-Group-673523320: creating Sep 01 12:37:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9058a413-d203-4667-bb2b-77b5df417e7d tempest-GroupsV314Test-1639539892 None] Group tempest-GroupsV314Test-Group-673523320: created successfully Sep 01 12:37:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9058a413-d203-4667-bb2b-77b5df417e7d tempest-GroupsV314Test-1639539892 None] Create group completed successfully. Sep 01 12:37:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-b03e7352-4531-4d87-9e75-8a4e314b34de req-ebd684b8-f803-4a88-802f-2f334715594d tempest-DeleteServersTestJSON-1841148469 None] Terminate volume connection completed successfully. Sep 01 12:37:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-b03e7352-4531-4d87-9e75-8a4e314b34de req-ebd684b8-f803-4a88-802f-2f334715594d tempest-DeleteServersTestJSON-1841148469 None] Deleting attachment e3ce9e28-59df-4a7c-b819-6809cace20ed. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Flow 'volume_create_manager' (21f45284-721a-4247-9a19-b8c6b3a9cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3847be4-7df8-47c0-81f6-049f4a04973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3847be4-7df8-47c0-81f6-049f4a04973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519104151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a0d230e-a42c-4536-adf8-47631439fb09,host='devstack@QuobyteHD#QuobyteHD',id=34acee18-991d-40c5-8491-19426693e7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd852dedced4fc0ad58aad7aec67656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:37:17Z,use_quota=True,user_id='791b8d6435fc4d5aa8f33d44ed861f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a577eb3c-4589-4773-b45f-6830523b4c57),volume_type_id=a577eb3c-4589-4773-b45f-6830523b4c57)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db8951-348d-4d65-a649-cf57d68dd15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5db8951-348d-4d65-a649-cf57d68dd15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c13bd-7951-4b55-a26a-5764f6e72e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686c13bd-7951-4b55-a26a-5764f6e72e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34acee18-991d-40c5-8491-19426693e7d9', 'volume_name': 'volume-34acee18-991d-40c5-8491-19426693e7d9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d1f99a-7fab-4f3c-b02a-41add35c3825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d1f99a-7fab-4f3c-b02a-41add35c3825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e18198a-1dab-4e58-b09a-12b68929a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Volume 34acee18-991d-40c5-8491-19426693e7d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34acee18-991d-40c5-8491-19426693e7d9', 'volume_size': 1} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a0d230e-a42c-4536-adf8-47631439fb09,created_at=2026-09-01T10:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519104151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a0d230e-a42c-4536-adf8-47631439fb09,host='devstack@QuobyteHD#QuobyteHD',id=34acee18-991d-40c5-8491-19426693e7d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dd852dedced4fc0ad58aad7aec67656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:37:17Z,use_quota=True,user_id='791b8d6435fc4d5aa8f33d44ed861f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a577eb3c-4589-4773-b45f-6830523b4c57),volume_type_id=a577eb3c-4589-4773-b45f-6830523b4c57)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Creating volume 34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:37:17 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:17 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 1073741824 Sep 01 12:37:17 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:17 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 1073741824" returned: 0 in 0.625s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:17 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:17 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:18 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e18198a-1dab-4e58-b09a-12b68929a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34acee18-991d-40c5-8491-19426693e7d9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f99a3e-8b02-48f6-ab7a-b9328ecbf4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:37:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Volume volume-34acee18-991d-40c5-8491-19426693e7d9 (34acee18-991d-40c5-8491-19426693e7d9): created successfully Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f99a3e-8b02-48f6-ab7a-b9328ecbf4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:37:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Flow 'volume_create_manager' (21f45284-721a-4247-9a19-b8c6b3a9cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:37:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6717f77f-1fe5-48c3-8a39-cc7fa40c8585 tempest-GroupsV314Test-1639539892 None] Created volume successfully. Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "cinder-68f8f145-73bc-4797-9931-d922b8db8447-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "cinder-68f8f145-73bc-4797-9931-d922b8db8447-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "cinder-quobyte-68f8f145-73bc-4797-9931-d922b8db8447" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "cinder-quobyte-68f8f145-73bc-4797-9931-d922b8db8447" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[575cea1f-026b-42d5-ba2e-808fcde46fc2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:20 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 Sep 01 12:37:20 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:20 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Cloning volume 34acee18-991d-40c5-8491-19426693e7d9 to volume cb713034-6c39-4b3a-aa8c-0dc146b262d1 Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Creating offline snapshot e12523a3-c6df-461e-ae1b-84b669e8eb23 of volume 34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c983e18a-52c9-4365-8eeb-bd8b28f192ff]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:20 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:20 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:20 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447" returned: 0 in 0.566s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:20 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447 Sep 01 12:37:20 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:20 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.457s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:21 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 1G Sep 01 12:37:21 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:21 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-68f8f145-73bc-4797-9931-d922b8db8447" returned: 0 in 0.406s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "cinder-quobyte-68f8f145-73bc-4797-9931-d922b8db8447" released by "delete_volume" :: held 1.044s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Created reservations ['e2cc4f0a-a304-4b5e-b1af-4a56d03e433e', 'fe1ba53b-cd48-4fb0-9064-54ae3d77ddd0', 'cbb2cc3d-9c99-472d-8cff-8a5b68bc47c2', 'bf1398b0-df79-42a7-a1f8-4c5d5be286e8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:21 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:37:21 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:21 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 1G" returned: 0 in 0.592s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34acee18-991d-40c5-8491-19426693e7d9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:21 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34acee18-991d-40c5-8491-19426693e7d9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:21 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:21 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.416s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:37:21 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Deleted volume successfully. Sep 01 12:37:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6015a306-2236-4847-bcb2-45030d2cf573 tempest-DeleteServersTestJSON-1841148469 None] Lock "cinder-68f8f145-73bc-4797-9931-d922b8db8447-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:22 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34acee18-991d-40c5-8491-19426693e7d9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:22 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:22 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:22 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:22 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info Sep 01 12:37:22 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:22 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info" returned: 0 in 0.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:37:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:22 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info Sep 01 12:37:22 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:23 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.info" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Acquiring lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] snapshot: e12523a3-c6df-461e-ae1b-84b669e8eb23, volume: cb713034-6c39-4b3a-aa8c-0dc146b262d1, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd2cf1-2eb7-4708-9106-0786de179c8d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:23 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:23 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:23 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34acee18-991d-40c5-8491-19426693e7d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5dc1a-5511-419b-8a42-6e1cfad3ae40]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:23 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:23 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:23 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.413s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:37:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:24 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 Sep 01 12:37:24 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:26 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:37:26 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:27 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.800s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:37:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:37:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 8 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:37:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:37:29 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1" returned: 0 in 5.858s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:29 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:37:29 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Converted 1024.00 MB image at 174.76 MB/s Sep 01 12:37:29 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:37:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:29 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 Sep 01 12:37:29 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:30 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" released by "_copy_volume_from_snapshot" :: held 7.119s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Acquiring lock "cinder-quobyte-e12523a3-c6df-461e-ae1b-84b669e8eb23" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-e12523a3-c6df-461e-ae1b-84b669e8eb23" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Deleting offline snapshot e12523a3-c6df-461e-ae1b-84b669e8eb23 of volume 34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] snapshot_file for this snap is: volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe5443-2f62-471d-8a6f-8b717d3105f8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:30 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:30 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:30 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.529s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34acee18-991d-40c5-8491-19426693e7d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6824bce6-4cd1-4b3d-adb8-d06132a47a7e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:31 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:31 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:31 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.890s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:31 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:31 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:32 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:32 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23 Sep 01 12:37:32 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=25,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:37:32 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9.e12523a3-c6df-461e-ae1b-84b669e8eb23" returned: 0 in 0.339s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-e12523a3-c6df-461e-ae1b-84b669e8eb23" released by "_delete_snapshot" :: held 2.342s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.158s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a0186ef2-fe8a-43f1-9292-441c815fbc94 tempest-GroupsV314Test-1639539892 None] Create group from source-group-8a0d230e-a42c-4536-adf8-47631439fb09 completed successfully. Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Acquiring lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68cf98e-c0de-4242-9181-b3ca4dbc1562]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:34 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 Sep 01 12:37:34 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:34 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1" returned: 0 in 0.470s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:34 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1 Sep 01 12:37:34 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:35 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cb713034-6c39-4b3a-aa8c-0dc146b262d1" returned: 0 in 0.270s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-cb713034-6c39-4b3a-aa8c-0dc146b262d1" released by "delete_volume" :: held 0.807s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Created reservations ['98153e8d-9fa5-434c-a542-f91ddf7c17c2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:37:35 devstack cinder-volume[87008]: WARNING cinder.quota [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-365773395 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-365773395, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:37:35 devstack cinder-volume[87008]: WARNING cinder.quota [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-365773395 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-365773395, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Created reservations ['1c285151-c798-4cdc-8837-9a0375361b58', '5d1c7a22-4b4e-4eb8-8b0d-159bcee143c1', '93e3f67c-3c72-4f7c-9642-f43e799a404b', 'cd512a9e-fb63-457b-aa64-49fe4473514e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:35 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:37:35 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:35 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:35 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:37:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bc1a2b23-9218-4903-addd-fb9011644bc7 tempest-GroupsV314Test-1639539892 None] Delete group completed successfully. Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Acquiring lock "cinder-quobyte-34acee18-991d-40c5-8491-19426693e7d9" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-34acee18-991d-40c5-8491-19426693e7d9" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5efe23-533f-4e23-b020-f20f3dfed23f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:36 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:36 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:36 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.458s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:36 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9 Sep 01 12:37:36 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:36 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-34acee18-991d-40c5-8491-19426693e7d9" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Lock "cinder-quobyte-34acee18-991d-40c5-8491-19426693e7d9" released by "delete_volume" :: held 0.878s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Created reservations ['2660bbae-c187-465c-a386-51254c399c44'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Created reservations ['2d7e9131-f182-4cb3-a8cf-855c0665bcf2', 'f2340a23-807f-4a42-8a51-933ca9e2009b', '960e3f10-f752-4807-97b2-8e49df22b51e', '9aaa88cc-c9e7-4dac-bd2d-aab1d3eef1b9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:37:37 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:37:37 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:37:37 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.298s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:37:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:37:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4fc5c6e1-bfbc-46fb-9cbd-1581c594e2c9 tempest-GroupsV314Test-1639539892 None] Delete group completed successfully. Sep 01 12:37:47 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:37:47 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Flow 'volume_create_manager' (09690ff4-f5e0-4964-a0b8-20920d1e600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42375b2-d879-4830-95c5-6d8df64bcc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42375b2-d879-4830-95c5-6d8df64bcc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1309791416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb8b494-f1af-48c9-b64c-dce6a7bcaabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8423873c49a4f0eb3df39f80193e018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:11Z,use_quota=True,user_id='6911f5a94e4d40d0ac579bdc12b0751c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aeb1f5-8f88-4456-aad2-f8abfe106d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07aeb1f5-8f88-4456-aad2-f8abfe106d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b4482-1ff2-4e97-ad9c-a80a28379fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b4482-1ff2-4e97-ad9c-a80a28379fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb8b494-f1af-48c9-b64c-dce6a7bcaabb', 'volume_name': 'volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e609c0c-555b-440d-8ef3-6489e759a5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e609c0c-555b-440d-8ef3-6489e759a5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273da97-0999-41de-989c-eac03dad3835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Volume 6cb8b494-f1af-48c9-b64c-dce6a7bcaabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb', 'volume_size': 1} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1309791416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb8b494-f1af-48c9-b64c-dce6a7bcaabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8423873c49a4f0eb3df39f80193e018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:11Z,use_quota=True,user_id='6911f5a94e4d40d0ac579bdc12b0751c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Creating volume 6cb8b494-f1af-48c9-b64c-dce6a7bcaabb {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:10 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:10 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb 1073741824 Sep 01 12:38:10 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:11 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb 1073741824" returned: 0 in 0.607s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:11 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb Sep 01 12:38:11 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:11 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4273da97-0999-41de-989c-eac03dad3835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff4037-4f2c-460b-8c45-51d086b1e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Volume volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb (6cb8b494-f1af-48c9-b64c-dce6a7bcaabb): created successfully Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff4037-4f2c-460b-8c45-51d086b1e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Flow 'volume_create_manager' (09690ff4-f5e0-4964-a0b8-20920d1e600d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3d6a538f-14c4-4ed5-8cbf-c53e4a83b369 tempest-VolumesServicesTestJSON-2060737284 None] Created volume successfully. Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Acquiring lock "cinder-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "cinder-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Acquiring lock "cinder-quobyte-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "cinder-quobyte-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ce4dd-bd1c-4ff5-b661-5f85c25b1cf3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Flow 'volume_create_manager' (6be9ee40-5933-4872-afc0-ac361451c4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae94fa5-8608-4223-b6b9-f167744550fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae94fa5-8608-4223-b6b9-f167744550fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-206019316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07a838-56d8-46bd-8f15-7b5a92147647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff4bbed5c204294aa17676610635887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:14Z,use_quota=True,user_id='4a00f95589af4571af34309d06127190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9f757a-258b-4bad-a0a9-7b0415913d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9f757a-258b-4bad-a0a9-7b0415913d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf366b-b7be-400d-8f66-ad35d5dc3e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf366b-b7be-400d-8f66-ad35d5dc3e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d07a838-56d8-46bd-8f15-7b5a92147647', 'volume_name': 'volume-5d07a838-56d8-46bd-8f15-7b5a92147647', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ef16c6-73b6-4687-8cd3-c88f67857dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:13 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb Sep 01 12:38:13 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ef16c6-73b6-4687-8cd3-c88f67857dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a03778-7943-44d5-b583-e5daea5f3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:13 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Volume 5d07a838-56d8-46bd-8f15-7b5a92147647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d07a838-56d8-46bd-8f15-7b5a92147647', 'volume_size': 1} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-206019316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d07a838-56d8-46bd-8f15-7b5a92147647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff4bbed5c204294aa17676610635887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:14Z,use_quota=True,user_id='4a00f95589af4571af34309d06127190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Creating volume 5d07a838-56d8-46bd-8f15-7b5a92147647 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:13 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:14 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 1073741824 Sep 01 12:38:14 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Flow 'volume_create_manager' (0b870b68-7f31-4595-846d-03a2631be021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d86ff-ec7d-44be-acea-1215fe7ca83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d86ff-ec7d-44be-acea-1215fe7ca83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-559007303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b370d2-d360-4003-a165-cd375599edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02358288b72b43809e8c7909a59f124a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:14Z,use_quota=True,user_id='9be6fa95d79c47e59ce61f9d7fc6cab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5252105a-c6f6-4a8e-8734-efdbb30beff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5252105a-c6f6-4a8e-8734-efdbb30beff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b2b570-79d2-4d7b-bb54-fdb901c3e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b2b570-79d2-4d7b-bb54-fdb901c3e398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b370d2-d360-4003-a165-cd375599edfe', 'volume_name': 'volume-00b370d2-d360-4003-a165-cd375599edfe', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42da865-3647-43aa-a698-d3def394add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42da865-3647-43aa-a698-d3def394add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2b50c9-766c-45e6-9604-28173499a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:14 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Volume 00b370d2-d360-4003-a165-cd375599edfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b370d2-d360-4003-a165-cd375599edfe', 'volume_size': 1} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:14 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" returned: 0 in 1.002s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:14 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb Sep 01 12:38:14 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:14 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 1073741824" returned: 0 in 0.897s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:15 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 Sep 01 12:38:15 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:15 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" returned: 0 in 0.619s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "cinder-quobyte-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb" released by "delete_volume" :: held 1.713s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Created reservations ['63ba1037-2b46-42cd-929b-2584ca072369', '3ceaf083-6c90-4048-b5c7-673d7c801111', 'a6df7e96-ee1e-4d19-a2ee-f1741b435e11', '1047d466-8040-467d-9efe-401e35b1f446'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:38:15 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647" returned: 0 in 0.414s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-559007303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b370d2-d360-4003-a165-cd375599edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02358288b72b43809e8c7909a59f124a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:14Z,use_quota=True,user_id='9be6fa95d79c47e59ce61f9d7fc6cab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Creating volume 00b370d2-d360-4003-a165-cd375599edfe {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:15 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:15 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe 1073741824 Sep 01 12:38:15 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a03778-7943-44d5-b583-e5daea5f3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d07a838-56d8-46bd-8f15-7b5a92147647', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:15 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:38:15 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c9d1e9-be51-48e4-b9c2-97fe5b66dd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:15 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Volume volume-5d07a838-56d8-46bd-8f15-7b5a92147647 (5d07a838-56d8-46bd-8f15-7b5a92147647): created successfully Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c9d1e9-be51-48e4-b9c2-97fe5b66dd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Flow 'volume_create_manager' (6be9ee40-5933-4872-afc0-ac361451c4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8d6f9387-842c-45bf-87c1-7117ad930c84 tempest-ServerActionsTestOtherA-1430068175 None] Created volume successfully. Sep 01 12:38:16 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.666s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:38:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Deleted volume successfully. Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-214dbd5a-a492-4f3a-ba76-c52695ff31b7 tempest-VolumesServicesTestJSON-2060737284 None] Lock "cinder-6cb8b494-f1af-48c9-b64c-dce6a7bcaabb-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:38:16 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe 1073741824" returned: 0 in 0.822s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:16 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe Sep 01 12:38:16 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:16 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe" returned: 0 in 0.440s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2b50c9-766c-45e6-9604-28173499a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b370d2-d360-4003-a165-cd375599edfe', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c338ce-19b0-4aa9-9136-812f2495d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Volume volume-00b370d2-d360-4003-a165-cd375599edfe (00b370d2-d360-4003-a165-cd375599edfe): created successfully Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c338ce-19b0-4aa9-9136-812f2495d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Flow 'volume_create_manager' (0b870b68-7f31-4595-846d-03a2631be021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-73443b8e-febb-4097-ab81-21fda1f13510 tempest-AttachVolumeShelveTestJSON-1316514730 None] Created volume successfully. Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:26 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:38:26 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=20,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:38:26 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:38:27 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.584s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:38:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:38:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 8 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:38:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:38:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-5dd302e8-0332-4278-90a0-87af73477292 req-ff7d4e62-608e-446c-b7b5-75d927e777c2 tempest-AttachVolumeShelveTestJSON-1316514730 None] No connector for attachment edda2bf5-da43-4269-9216-3ad9e6382a75; skipping storage backend terminate_connection call. {{(pid=87008) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 12:38:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-5dd302e8-0332-4278-90a0-87af73477292 req-ff7d4e62-608e-446c-b7b5-75d927e777c2 tempest-AttachVolumeShelveTestJSON-1316514730 None] Deleting attachment edda2bf5-da43-4269-9216-3ad9e6382a75. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Flow 'volume_create_manager' (54845c88-39de-4e5c-afe2-90aa237c3722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfc0dc1-27e5-4fde-be51-da0635ea0a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfc0dc1-27e5-4fde-be51-da0635ea0a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-539716469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5af9dee-658d-44aa-9b3d-84dc6d637483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c305747ed144aeb9dcc8a08ca8dfa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:35Z,use_quota=True,user_id='5c5ae49920d5495587b7c503b2f84a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5da53b-e418-42a2-919c-33cdec5da452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5da53b-e418-42a2-919c-33cdec5da452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759915d5-1647-4e7e-b91b-e817f6a8314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:35 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759915d5-1647-4e7e-b91b-e817f6a8314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5af9dee-658d-44aa-9b3d-84dc6d637483', 'volume_name': 'volume-c5af9dee-658d-44aa-9b3d-84dc6d637483', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b76b35-57f1-4e0b-841e-06c3751be8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b76b35-57f1-4e0b-841e-06c3751be8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633c871c-f568-48ae-994f-5559d70271f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Volume c5af9dee-658d-44aa-9b3d-84dc6d637483: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5af9dee-658d-44aa-9b3d-84dc6d637483', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Trying to clone c5af9dee-658d-44aa-9b3d-84dc6d637483 from image 903fc775-9c21-408b-9650-9b60d3b1eb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (9e77a355-881b-436e-bf0d-d4787d3bd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dfea64-6781-4c84-af53-47ed210a1d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dfea64-6781-4c84-af53-47ed210a1d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-954554960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5afe53c-e564-4b5d-b3ba-9155d785cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:36Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a7626e-46dd-4059-bec6-b16c67894ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a7626e-46dd-4059-bec6-b16c67894ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c835e28-b223-4208-9f55-f900ef32b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c835e28-b223-4208-9f55-f900ef32b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5afe53c-e564-4b5d-b3ba-9155d785cd20', 'volume_name': 'volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac6542e-3249-4086-8038-2709f491d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac6542e-3249-4086-8038-2709f491d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3f0a9c-7798-47de-970f-a80a8b14b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Volume f5afe53c-e564-4b5d-b3ba-9155d785cd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20', 'volume_size': 1} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-954554960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5afe53c-e564-4b5d-b3ba-9155d785cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:36Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Creating volume f5afe53c-e564-4b5d-b3ba-9155d785cd20 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:36 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:36 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 1073741824 Sep 01 12:38:36 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:38:37 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b31796a-0ca5-4644-ad6c-dbc652c38c49]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:37 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 1073741824" returned: 0 in 0.755s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:37 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 Sep 01 12:38:37 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:37 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD Sep 01 12:38:37 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:37 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20" returned: 0 in 0.319s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3f0a9c-7798-47de-970f-a80a8b14b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f59e402-5a1a-4dc6-97d4-994ec01ed31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:37 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Volume volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 (f5afe53c-e564-4b5d-b3ba-9155d785cd20): created successfully Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f59e402-5a1a-4dc6-97d4-994ec01ed31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (9e77a355-881b-436e-bf0d-d4787d3bd880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7d08a9e0-2edc-46ed-be93-bfee20dd0c41 tempest-AttachVolumeTestJSON-1935244478 None] Created volume successfully. Sep 01 12:38:37 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD" returned: 0 in 0.602s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 is fetched for user 5c5ae49920d5495587b7c503b2f84a85. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b0d5d4-774f-41d3-a839-95e61a951162]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:37 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD Sep 01 12:38:37 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:38 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-539716469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5af9dee-658d-44aa-9b3d-84dc6d637483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c305747ed144aeb9dcc8a08ca8dfa7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:35Z,use_quota=True,user_id='5c5ae49920d5495587b7c503b2f84a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Creating volume c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:38 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1073741824 Sep 01 12:38:38 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:39 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1073741824" returned: 0 in 0.807s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:39 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 Sep 01 12:38:39 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:39 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483" returned: 0 in 0.423s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-5e16f3c5-1aac-4f95-85e3-56d735617c6c req-49c97ea0-bc6b-477f-ae8d-a838a03c449a tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-5e16f3c5-1aac-4f95-85e3-56d735617c6c req-49c97ea0-bc6b-477f-ae8d-a838a03c449a tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-5e16f3c5-1aac-4f95-85e3-56d735617c6c req-49c97ea0-bc6b-477f-ae8d-a838a03c449a tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Attempting download of 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume c5af9dee-658d-44aa-9b3d-84dc6d637483. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-5e16f3c5-1aac-4f95-85e3-56d735617c6c req-49c97ea0-bc6b-477f-ae8d-a838a03c449a tempest-AttachVolumeTestJSON-1935244478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '106b3a21-e0f6-40b6-80fb-f36606da10fe', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd051e27-51e7-4558-97b1-7893fb9ad294]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-5e16f3c5-1aac-4f95-85e3-56d735617c6c req-49c97ea0-bc6b-477f-ae8d-a838a03c449a tempest-AttachVolumeTestJSON-1935244478 None] attachment_update completed successfully. Sep 01 12:38:39 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty Sep 01 12:38:39 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:40 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty" returned: 0 in 0.490s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:40 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty Sep 01 12:38:40 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:40 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty" returned: 1 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_pdo215ty' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7612373-a345-4c99-9d38-e5e289639272]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:40 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD Sep 01 12:38:40 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:41 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:41 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] 903fc775-9c21-408b-9650-9b60d3b1eb91 was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:38:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:41 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 Sep 01 12:38:41 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:43 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483" returned: 0 in 2.098s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_h_73n3ptdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:38:43 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Converted 112.00 MB image at 53.35 MB/s Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:43 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1G Sep 01 12:38:43 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:43 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 1G" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Downloaded image 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume c5af9dee-658d-44aa-9b3d-84dc6d637483 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 for user 5c5ae49920d5495587b7c503b2f84a85 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Marking volume c5af9dee-658d-44aa-9b3d-84dc6d637483 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Copying metadata from image 903fc775-9c21-408b-9650-9b60d3b1eb91 to c5af9dee-658d-44aa-9b3d-84dc6d637483. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Creating volume glance metadata for volume c5af9dee-658d-44aa-9b3d-84dc6d637483 backed by image 903fc775-9c21-408b-9650-9b60d3b1eb91 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633c871c-f568-48ae-994f-5559d70271f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5af9dee-658d-44aa-9b3d-84dc6d637483', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9021cf-5e09-4b00-b58f-ae90b821a658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:43 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Volume volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 (c5af9dee-658d-44aa-9b3d-84dc6d637483): created successfully Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9021cf-5e09-4b00-b58f-ae90b821a658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Flow 'volume_create_manager' (54845c88-39de-4e5c-afe2-90aa237c3722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-07154870-1741-4317-a592-82bec8f2e65c tempest-VolumesImageMetadata-258008717 None] Created volume successfully. Sep 01 12:38:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Acquiring lock "cinder-c5af9dee-658d-44aa-9b3d-84dc6d637483-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:38:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "cinder-c5af9dee-658d-44aa-9b3d-84dc6d637483-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:38:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Acquiring lock "cinder-quobyte-c5af9dee-658d-44aa-9b3d-84dc6d637483" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:38:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "cinder-quobyte-c5af9dee-658d-44aa-9b3d-84dc6d637483" acquired by "delete_volume" :: waited 0.046s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:38:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc59305-3c2d-45b2-a7eb-7ef7947db4cb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:45 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 Sep 01 12:38:45 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:46 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483" returned: 0 in 0.884s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:46 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483 Sep 01 12:38:46 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:46 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c5af9dee-658d-44aa-9b3d-84dc6d637483" returned: 0 in 0.914s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "cinder-quobyte-c5af9dee-658d-44aa-9b3d-84dc6d637483" released by "delete_volume" :: held 1.928s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Created reservations ['1340a31e-58c6-45f3-9fbb-132be5125b37', '57794d0a-9fea-475a-bea9-e5be95208fb2', 'fc09f529-1dd4-4cbc-b0ab-6877d2fae8e8', 'a5157536-f818-4a06-bfe9-0fa84b8bcdbd'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:47 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:38:47 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:47 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.596s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:48 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:38:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Deleted volume successfully. Sep 01 12:38:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-66cfb8a8-a62f-4db3-b8c4-b604b16be9bf tempest-VolumesImageMetadata-258008717 None] Lock "cinder-c5af9dee-658d-44aa-9b3d-84dc6d637483-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-e6f3b575-58c6-4f65-9851-825ccf29eac1 req-a8dc2157-364a-49ca-86b0-3f1f56502a05 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-e6f3b575-58c6-4f65-9851-825ccf29eac1 req-a8dc2157-364a-49ca-86b0-3f1f56502a05 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-e6f3b575-58c6-4f65-9851-825ccf29eac1 req-a8dc2157-364a-49ca-86b0-3f1f56502a05 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-e6f3b575-58c6-4f65-9851-825ccf29eac1 req-a8dc2157-364a-49ca-86b0-3f1f56502a05 tempest-ServerActionsTestOtherA-1430068175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-5d07a838-56d8-46bd-8f15-7b5a92147647', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6681d8e5-83ac-4dcf-b448-f20c2fe7865c', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:38:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-e6f3b575-58c6-4f65-9851-825ccf29eac1 req-a8dc2157-364a-49ca-86b0-3f1f56502a05 tempest-ServerActionsTestOtherA-1430068175 None] attachment_update completed successfully. Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Flow 'volume_create_manager' (40549fd4-c66e-4ca3-aa5a-633387fbaa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fadd2f-e732-4789-9406-43462175b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fadd2f-e732-4789-9406-43462175b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-650641563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9655a9af-97a2-4e65-8df6-b2d9521466d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba071f74084858b84d059c5e7a5264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:53Z,use_quota=True,user_id='9242fc181d17429db0095d71159cd43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640035da-765b-467e-9f4f-ac7919ad9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640035da-765b-467e-9f4f-ac7919ad9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b34d9-c96d-44d5-ab5d-f2bca139c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b34d9-c96d-44d5-ab5d-f2bca139c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9655a9af-97a2-4e65-8df6-b2d9521466d5', 'volume_name': 'volume-9655a9af-97a2-4e65-8df6-b2d9521466d5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b52b768-0e54-4fc1-841d-2ddb6f614732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b52b768-0e54-4fc1-841d-2ddb6f614732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a9938a-48c6-4a35-8357-569802943a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Volume 9655a9af-97a2-4e65-8df6-b2d9521466d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9655a9af-97a2-4e65-8df6-b2d9521466d5', 'volume_size': 1} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-650641563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9655a9af-97a2-4e65-8df6-b2d9521466d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba071f74084858b84d059c5e7a5264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:53Z,use_quota=True,user_id='9242fc181d17429db0095d71159cd43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Creating volume 9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:38:53 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:53 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 1073741824 Sep 01 12:38:53 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:53 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 1073741824" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:53 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:38:53 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:53 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a9938a-48c6-4a35-8357-569802943a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9655a9af-97a2-4e65-8df6-b2d9521466d5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a171140-35bc-43a3-966d-8a7e7e9feb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Volume volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 (9655a9af-97a2-4e65-8df6-b2d9521466d5): created successfully Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a171140-35bc-43a3-966d-8a7e7e9feb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Flow 'volume_create_manager' (40549fd4-c66e-4ca3-aa5a-633387fbaa9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1fdca51f-9911-4a78-93f6-14bc7b7bad17 tempest-VolumesCloneTest-211533527 None] Created volume successfully. Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Flow 'volume_create_manager' (9b52209b-b587-4bfb-84aa-c9d1ea70d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61204d0-d78c-4796-9ed5-c0d63b1cccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61204d0-d78c-4796-9ed5-c0d63b1cccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1372178937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be095ac8-ecdd-4ccf-94cc-2cfd61e70b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba071f74084858b84d059c5e7a5264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:38:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9655a9af-97a2-4e65-8df6-b2d9521466d5,status='creating',terminated_at=None,updated_at=2026-09-01T10:38:56Z,use_quota=True,user_id='9242fc181d17429db0095d71159cd43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025d86a0-7f85-45b5-abe8-319adb27ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025d86a0-7f85-45b5-abe8-319adb27ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c02fc5f-d585-4080-9888-2634184633ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c02fc5f-d585-4080-9888-2634184633ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'be095ac8-ecdd-4ccf-94cc-2cfd61e70b75', 'volume_name': 'volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75', 'volume_size': 2, 'source_volid': '9655a9af-97a2-4e65-8df6-b2d9521466d5', 'source_volstatus': 'available'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a6639-b512-4f38-8e82-31f91345b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a6639-b512-4f38-8e82-31f91345b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab50deb-653e-484d-86d3-5c8bb23fb55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:38:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Volume be095ac8-ecdd-4ccf-94cc-2cfd61e70b75: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75', 'volume_size': 2, 'source_volid': '9655a9af-97a2-4e65-8df6-b2d9521466d5', 'source_volstatus': 'available'} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:56 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Cloning volume 9655a9af-97a2-4e65-8df6-b2d9521466d5 to volume be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Creating offline snapshot 888a9aac-7710-48cf-a4d0-15468f6d0f5e of volume 9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4b992-aafb-4789-be15-6da97c92f147]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:56 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:38:56 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-1d997cdd-6d15-455a-a041-6f3b4372fa9e tempest-ServerActionsTestOtherA-1430068175 None] Terminate volume connection completed successfully. Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-1d997cdd-6d15-455a-a041-6f3b4372fa9e tempest-ServerActionsTestOtherA-1430068175 None] Deleting attachment 6681d8e5-83ac-4dcf-b448-f20c2fe7865c. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:38:56 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.840s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:57 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e 1G Sep 01 12:38:57 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:57 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e 1G" returned: 0 in 0.832s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:57 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:38:57 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-d6630979-a665-46b6-a3d6-c48fa9170e45 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:58 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:58 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e is being set with open permissions: ugo+rw Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:58 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:38:58 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:58 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:58 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info Sep 01 12:38:58 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:58 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:58 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info is being set with open permissions: ugo+rw Sep 01 12:38:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:58 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info Sep 01 12:38:58 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:59 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.info" returned: 0 in 0.280s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] snapshot: 888a9aac-7710-48cf-a4d0-15468f6d0f5e, volume: be095ac8-ecdd-4ccf-94cc-2cfd61e70b75, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d7a64-9d48-48dd-8920-03a4699c97cc]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:59 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:38:59 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:59 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9655a9af-97a2-4e65-8df6-b2d9521466d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcdc746-f801-4e2d-82dd-c3e9e759fa46]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:59 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:38:59 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:38:59 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.428s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:38:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:38:59 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 Sep 01 12:38:59 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:05 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" returned: 0 in 6.034s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:05 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:39:05 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Converted 1024.00 MB image at 169.68 MB/s Sep 01 12:39:05 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 is being set with open permissions: ugo+rw Sep 01 12:39:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:06 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 Sep 01 12:39:06 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:06 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" returned: 0 in 0.244s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" released by "_copy_volume_from_snapshot" :: held 7.179s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-quobyte-888a9aac-7710-48cf-a4d0-15468f6d0f5e" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-888a9aac-7710-48cf-a4d0-15468f6d0f5e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Deleting offline snapshot 888a9aac-7710-48cf-a4d0-15468f6d0f5e of volume 9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] snapshot_file for this snap is: volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[961397e7-d7ca-4297-bbf6-a5963587849b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:06 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:39:06 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:06 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.400s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9655a9af-97a2-4e65-8df6-b2d9521466d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae78394-6cec-42c1-9f51-1402cc4a15e6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:06 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:39:06 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:07 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.537s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:07 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:39:07 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:07 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:07 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e Sep 01 12:39:07 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:07 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5.888a9aac-7710-48cf-a4d0-15468f6d0f5e" returned: 0 in 0.252s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-888a9aac-7710-48cf-a4d0-15468f6d0f5e" released by "_delete_snapshot" :: held 1.625s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.894s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-d6630979-a665-46b6-a3d6-c48fa9170e45 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.043s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-d6630979-a665-46b6-a3d6-c48fa9170e45 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab50deb-653e-484d-86d3-5c8bb23fb55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75', 'volume_size': 2, 'source_volid': '9655a9af-97a2-4e65-8df6-b2d9521466d5', 'source_volstatus': 'available'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8affcf-c3d4-4c26-8768-722b4307ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Volume volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 (be095ac8-ecdd-4ccf-94cc-2cfd61e70b75): created successfully Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8affcf-c3d4-4c26-8768-722b4307ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Flow 'volume_create_manager' (9b52209b-b587-4bfb-84aa-c9d1ea70d70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-d6630979-a665-46b6-a3d6-c48fa9170e45 tempest-ServerActionsTestOtherA-1430068175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-5d07a838-56d8-46bd-8f15-7b5a92147647', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8129ea8a-7ca9-4456-ae84-3ed2573c112d', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:39:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b4f29400-675b-4daa-b11d-466096255974 tempest-VolumesCloneTest-211533527 None] Created volume successfully. Sep 01 12:39:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-dbe8b287-5815-4417-a855-79530cc3cf16 req-d6630979-a665-46b6-a3d6-c48fa9170e45 tempest-ServerActionsTestOtherA-1430068175 None] attachment_update completed successfully. Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "cinder-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87bb75-9f11-4606-89ab-3bfbf5bb3bda]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:08 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 Sep 01 12:39:08 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:08 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" returned: 0 in 0.370s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:08 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75 Sep 01 12:39:08 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:09 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75" released by "delete_volume" :: held 0.682s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Created reservations ['6c40848e-9722-482e-9fc4-7a01e3b8b808', 'fcee85e1-1e0d-4ae9-8978-61ea149002de', '0ceefeb2-9b26-42f5-924e-b2b54d414aa9', '1cf7f9d2-f52c-41fd-9d78-6ccb9c543290'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:09 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:09 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:09 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.359s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-9655a9af-97a2-4e65-8df6-b2d9521466d5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Deleted volume successfully. Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "cinder-9655a9af-97a2-4e65-8df6-b2d9521466d5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5df523e7-bb22-4714-a8bb-a6643f62ea48 tempest-VolumesCloneTest-211533527 None] Lock "cinder-be095ac8-ecdd-4ccf-94cc-2cfd61e70b75-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Acquiring lock "cinder-quobyte-9655a9af-97a2-4e65-8df6-b2d9521466d5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-9655a9af-97a2-4e65-8df6-b2d9521466d5" acquired by "delete_volume" :: waited 0.061s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cf618-2f06-4c54-87dd-5ef7126e9b02]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:10 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:39:10 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:10 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.854s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:10 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5 Sep 01 12:39:10 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:11 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9655a9af-97a2-4e65-8df6-b2d9521466d5" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "cinder-quobyte-9655a9af-97a2-4e65-8df6-b2d9521466d5" released by "delete_volume" :: held 1.536s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Created reservations ['6ac63ff9-e5b7-4a49-a741-19c5a3b99b94', '171260fd-0eef-40e8-9559-9145db762aff', '0b314e17-11ea-47b7-a114-e732a3ee282f', '45d0ac11-8e37-4856-bfbf-2eab35896112'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:11 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:11 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:12 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.684s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:12 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Deleted volume successfully. Sep 01 12:39:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b545800-f3b6-4dc1-8d2a-ce983f584595 tempest-VolumesCloneTest-211533527 None] Lock "cinder-9655a9af-97a2-4e65-8df6-b2d9521466d5-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-45ba5892-fdf1-4168-95c3-32d53f453928 req-d492857f-6aef-4dea-9794-56a81015328c tempest-AttachVolumeTestJSON-1935244478 None] Terminate volume connection completed successfully. Sep 01 12:39:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-45ba5892-fdf1-4168-95c3-32d53f453928 req-d492857f-6aef-4dea-9794-56a81015328c tempest-AttachVolumeTestJSON-1935244478 None] Deleting attachment 106b3a21-e0f6-40b6-80fb-f36606da10fe. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Acquiring lock "cinder-00b370d2-d360-4003-a165-cd375599edfe-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "cinder-00b370d2-d360-4003-a165-cd375599edfe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Acquiring lock "cinder-quobyte-00b370d2-d360-4003-a165-cd375599edfe" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "cinder-quobyte-00b370d2-d360-4003-a165-cd375599edfe" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de59cf6-4c3c-4df7-bce2-4f44990b21af]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:16 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe Sep 01 12:39:16 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Flow 'volume_create_manager' (3a3abe0e-2f26-4f46-b450-6fffe5e296d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff0365b-3b9a-4b1d-8e3a-4c1e1b58618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff0365b-3b9a-4b1d-8e3a-4c1e1b58618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1519687532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02d7432-d69e-4a1c-8001-dbc737dea9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb85fe8c5e400bbb9bb74eacfa3472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:16Z,use_quota=True,user_id='e8b2e193cc214cf0a92d2137cf216d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2ca9eb-7e5b-4c40-87e1-27e0acfe659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2ca9eb-7e5b-4c40-87e1-27e0acfe659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe08f4a-f661-4188-aae4-20704257b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe08f4a-f661-4188-aae4-20704257b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02d7432-d69e-4a1c-8001-dbc737dea9cb', 'volume_name': 'volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ff9a1-1e3c-421d-a128-2e685a5f4164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ff9a1-1e3c-421d-a128-2e685a5f4164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e9cebc-d560-4b90-af9d-75c550a1a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Volume f02d7432-d69e-4a1c-8001-dbc737dea9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb', 'volume_size': 1} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1519687532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02d7432-d69e-4a1c-8001-dbc737dea9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb85fe8c5e400bbb9bb74eacfa3472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:16Z,use_quota=True,user_id='e8b2e193cc214cf0a92d2137cf216d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Creating volume f02d7432-d69e-4a1c-8001-dbc737dea9cb {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:16 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:16 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb 1073741824 Sep 01 12:39:16 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:16 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:16 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe Sep 01 12:39:16 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:16 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00b370d2-d360-4003-a165-cd375599edfe" returned: 0 in 0.332s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "cinder-quobyte-00b370d2-d360-4003-a165-cd375599edfe" released by "delete_volume" :: held 0.793s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Created reservations ['fbf8578b-9a50-4f68-b38c-ab5384a6d21b', '093ed307-8d12-40cf-8ef7-e5ce8c73a8d4', 'b93da254-8dd9-4304-b4ee-ee1376f4e150', '083e7dca-7377-4479-862a-6d1853ca20da'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:17 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb 1073741824" returned: 0 in 0.573s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:17 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:17 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:17 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb Sep 01 12:39:17 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:17 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.458s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Deleted volume successfully. Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-614ac335-b8c3-4bb3-b2b0-3a1971bcbc16 tempest-AttachVolumeShelveTestJSON-1316514730 None] Lock "cinder-00b370d2-d360-4003-a165-cd375599edfe-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:17 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb" returned: 0 in 0.545s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e9cebc-d560-4b90-af9d-75c550a1a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd49cb-9e2b-48d2-89eb-b7ed74e63d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Volume volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb (f02d7432-d69e-4a1c-8001-dbc737dea9cb): created successfully Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd49cb-9e2b-48d2-89eb-b7ed74e63d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Flow 'volume_create_manager' (3a3abe0e-2f26-4f46-b450-6fffe5e296d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f4ec4f06-6008-46ec-a045-aab6c7717274 tempest-VolumesNegativeTest-812854088 None] Created volume successfully. Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:26 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:26 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:27 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=62,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:39:27 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=64,cinder:UPDATE=56,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:39:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c7301a85-a7ec-47ca-a18b-bc30fd9e0e05 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-14314673: creating Sep 01 12:39:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c7301a85-a7ec-47ca-a18b-bc30fd9e0e05 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-14314673: created successfully Sep 01 12:39:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c7301a85-a7ec-47ca-a18b-bc30fd9e0e05 tempest-GroupSnapshotsTest-421436963 None] Create group completed successfully. Sep 01 12:39:32 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (1ba7f1c0-1e3e-43a9-b290-84bf9166ece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d820137e-7aa9-44b7-88b6-d2c4d395f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d820137e-7aa9-44b7-88b6-d2c4d395f910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929175324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62807218-fd6e-4f33-b6bd-ef57ae66d795,host='devstack@QuobyteHD#QuobyteHD',id=ec635abe-b433-438a-b7a6-ae2082b0804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:33Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2afa8d1-1d2c-40e5-a726-43ba54972e08),volume_type_id=f2afa8d1-1d2c-40e5-a726-43ba54972e08)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c11a18-81d8-4fcd-a9c0-e0e8ef916e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c11a18-81d8-4fcd-a9c0-e0e8ef916e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae94000-aa55-4f7f-9615-6e9102b57a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae94000-aa55-4f7f-9615-6e9102b57a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec635abe-b433-438a-b7a6-ae2082b0804f', 'volume_name': 'volume-ec635abe-b433-438a-b7a6-ae2082b0804f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73221c-b145-42d2-9d89-46727f8b5e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73221c-b145-42d2-9d89-46727f8b5e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890ca31-2686-4a92-be51-0a44e5c46d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:33 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Volume ec635abe-b433-438a-b7a6-ae2082b0804f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec635abe-b433-438a-b7a6-ae2082b0804f', 'volume_size': 1} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62807218-fd6e-4f33-b6bd-ef57ae66d795,created_at=2026-09-01T10:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929175324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62807218-fd6e-4f33-b6bd-ef57ae66d795,host='devstack@QuobyteHD#QuobyteHD',id=ec635abe-b433-438a-b7a6-ae2082b0804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:33Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2afa8d1-1d2c-40e5-a726-43ba54972e08),volume_type_id=f2afa8d1-1d2c-40e5-a726-43ba54972e08)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Creating volume ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:33 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:33 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f 1073741824 Sep 01 12:39:33 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:33 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f 1073741824" returned: 0 in 0.678s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:33 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:33 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:34 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.461s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9890ca31-2686-4a92-be51-0a44e5c46d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec635abe-b433-438a-b7a6-ae2082b0804f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9f24fd-cea2-4ae3-b6ff-2e676784836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Volume volume-ec635abe-b433-438a-b7a6-ae2082b0804f (ec635abe-b433-438a-b7a6-ae2082b0804f): created successfully Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9f24fd-cea2-4ae3-b6ff-2e676784836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (1ba7f1c0-1e3e-43a9-b290-84bf9166ece4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c9207645-0fc4-4fb8-9981-6c9f190b32ed tempest-GroupSnapshotsTest-421436963 None] Created volume successfully. Sep 01 12:39:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] GroupSnapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: creating. Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Group snapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: creating. {{(pid=87008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Creating offline snapshot 6c2bff8c-9676-4114-bd59-8ec25bd3976c of volume ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2dfb4-8c76-444c-b304-0a226421c5c4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:35 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:35 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:36 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.368s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:36 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c 1G Sep 01 12:39:36 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:36 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c 1G" returned: 0 in 0.441s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec635abe-b433-438a-b7a6-ae2082b0804f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:36 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec635abe-b433-438a-b7a6-ae2082b0804f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:36 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:37 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec635abe-b433-438a-b7a6-ae2082b0804f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:37 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:37 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:37 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:37 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info Sep 01 12:39:37 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:37 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:37 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info Sep 01 12:39:37 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:37 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.info" returned: 0 in 0.280s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e462e218-1359-492c-8b9a-07dca3c7b039 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: created successfully Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c-f87cefdb-0049-47e5-848f-74713e8f54a1" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c-f87cefdb-0049-47e5-848f-74713e8f54a1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Creating volume f87cefdb-0049-47e5-848f-74713e8f54a1 from snapshot 6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] snapshot: 6c2bff8c-9676-4114-bd59-8ec25bd3976c, volume: f87cefdb-0049-47e5-848f-74713e8f54a1, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735ce85-abed-4fb2-af38-83b126fd7523]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:39 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:39 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:40 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec635abe-b433-438a-b7a6-ae2082b0804f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5a82f-1de9-4ec4-b752-ca21382d7642]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:40 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:40 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:40 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:40 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 Sep 01 12:39:40 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Acquiring lock "cinder-f02d7432-d69e-4a1c-8001-dbc737dea9cb-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "cinder-f02d7432-d69e-4a1c-8001-dbc737dea9cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Acquiring lock "cinder-quobyte-f02d7432-d69e-4a1c-8001-dbc737dea9cb" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "cinder-quobyte-f02d7432-d69e-4a1c-8001-dbc737dea9cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f627d9-b03a-49cf-a873-e69fe1d70be6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:40 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb Sep 01 12:39:40 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:41 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb" returned: 0 in 0.623s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:41 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb Sep 01 12:39:41 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:42 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f02d7432-d69e-4a1c-8001-dbc737dea9cb" returned: 0 in 0.731s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "cinder-quobyte-f02d7432-d69e-4a1c-8001-dbc737dea9cb" released by "delete_volume" :: held 1.421s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Created reservations ['fa97878a-0b26-488c-a1ba-e53409200a69', '58ac0f7a-e52a-49fd-8945-e56e0c8b8422', '0de8062b-5ce3-4dc5-b264-670408fc36fd', '54a53aa0-b95c-4c1e-8b14-6abbfa7f91a9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:42 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:42 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:42 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.413s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:42 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Deleted volume successfully. Sep 01 12:39:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-720d617a-4c84-4fc5-8b28-47065deae08e tempest-VolumesNegativeTest-812854088 None] Lock "cinder-f02d7432-d69e-4a1c-8001-dbc737dea9cb-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:45 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1" returned: 0 in 5.156s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:45 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:39:45 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Converted 1024.00 MB image at 198.56 MB/s Sep 01 12:39:45 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:39:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:45 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 Sep 01 12:39:45 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:45 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1" returned: 0 in 0.252s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" released by "_copy_volume_from_snapshot" :: held 6.269s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c-f87cefdb-0049-47e5-848f-74713e8f54a1" released by "_create_volume_from_snapshot" :: held 6.343s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.369s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-98c8fbef-68c2-41fc-af70-03bb9489033e tempest-GroupSnapshotsTest-421436963 None] Create group from source-snapshot-2897c8d0-e4e2-49b6-91cb-20a8c27a4a29 completed successfully. Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba8e326-e572-44ca-9569-a3936690aeb8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:47 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 Sep 01 12:39:47 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:47 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1" returned: 0 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:47 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1 Sep 01 12:39:47 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:48 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f87cefdb-0049-47e5-848f-74713e8f54a1" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-f87cefdb-0049-47e5-848f-74713e8f54a1" released by "delete_volume" :: held 0.744s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Created reservations ['c4f97b06-af60-40bd-b770-99a32aa1b51f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:48 devstack cinder-volume[87008]: WARNING cinder.quota [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1242122236 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1242122236, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:39:48 devstack cinder-volume[87008]: WARNING cinder.quota [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1242122236 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1242122236, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Created reservations ['919ebd80-d786-4f80-846a-b1c1b4cdd8a2', '9564e67e-6a9c-4f72-b2d0-eb57a76ce5b7', '95951bca-cef0-42dd-a41f-b152d99cb5f6', 'ce26aff6-2c85-4ec8-8a52-9f3751b6ae6a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:48 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:48 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:48 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b2145729-ebf8-4ac1-8cf9-6591caae0c66 tempest-GroupSnapshotsTest-421436963 None] Delete group completed successfully. Sep 01 12:39:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: deleting Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: deleting {{(pid=87008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Deleting offline snapshot 6c2bff8c-9676-4114-bd59-8ec25bd3976c of volume ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] snapshot_file for this snap is: volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a5f4b-6864-4e83-a5d7-7cbd2a472078]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:48 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:48 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:49 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.423s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec635abe-b433-438a-b7a6-ae2082b0804f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae4aa12-0136-41c3-8c5c-859fbc781ec0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:49 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:49 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:49 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.585s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:49 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:49 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:50 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.495s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:50 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c Sep 01 12:39:50 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:50 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f.6c2bff8c-9676-4114-bd59-8ec25bd3976c" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-6c2bff8c-9676-4114-bd59-8ec25bd3976c" released by "_delete_snapshot" :: held 1.899s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" released by "delete_snapshot" :: held 1.929s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:50 devstack cinder-volume[87008]: WARNING cinder.quota [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1242122236 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1242122236, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:39:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] Created reservations ['84d23fd3-b10b-4004-995a-8aa819b4a1f1', 'ba70d61b-b2b2-42a0-8290-395d8c52d431', '563d0686-8d00-4afa-8ea4-a3497948ce58', '5725714e-1171-4cc8-b635-6b6735dc3c1f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d6627e1a-6e58-4e54-83e1-29d31ab42c08 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 2897c8d0-e4e2-49b6-91cb-20a8c27a4a29: deleted successfully Sep 01 12:39:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-1c89a4c6-8b91-4a04-ab77-251ca57dafe5 req-521c1602-1585-4750-b55a-184c7d2bd304 tempest-ServerActionsTestOtherA-1430068175 None] Terminate volume connection completed successfully. Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-1c89a4c6-8b91-4a04-ab77-251ca57dafe5 req-521c1602-1585-4750-b55a-184c7d2bd304 tempest-ServerActionsTestOtherA-1430068175 None] Deleting attachment 8129ea8a-7ca9-4456-ae84-3ed2573c112d. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe0234-4aee-4b33-8e52-ac52313ea42c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:51 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:51 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:51 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.582s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:52 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f Sep 01 12:39:52 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:52 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ec635abe-b433-438a-b7a6-ae2082b0804f" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-ec635abe-b433-438a-b7a6-ae2082b0804f" released by "delete_volume" :: held 1.032s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Created reservations ['ebb5339a-c01b-45b1-98b2-9f6499cd54bf'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:52 devstack cinder-volume[87008]: WARNING cinder.db.api [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1242122236'] Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Created reservations ['3eeb5c3b-7665-4051-ba22-9a50083505d6', '928609f8-1608-4ff2-a421-3fd1402150ca', 'b112cfd4-c3d3-4201-b5d6-b889d94181a0', 'f84914a9-9e7b-4803-983a-a8c6ec11a276'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:52 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:39:52 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:53 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:53 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:39:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a72c6a60-583c-4b58-ac35-a6ef760d3cc7 tempest-GroupSnapshotsTest-421436963 None] Delete group completed successfully. Sep 01 12:39:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-381f116b-ede4-4f02-acbb-76a7dc91e3a1 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-1329594224: creating Sep 01 12:39:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-381f116b-ede4-4f02-acbb-76a7dc91e3a1 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-1329594224: created successfully Sep 01 12:39:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-381f116b-ede4-4f02-acbb-76a7dc91e3a1 tempest-GroupSnapshotsTest-421436963 None] Create group completed successfully. Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (ed554378-3d54-4a85-af89-f795a84fbb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71686245-bc72-49d0-ac46-1d2f88bc7edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71686245-bc72-49d0-ac46-1d2f88bc7edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080998095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8860439-e907-4c88-b954-1d599cb6f43d,host='devstack@QuobyteHD#QuobyteHD',id=7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:55Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e23c56-7835-4c96-b4bc-0325db947dd4),volume_type_id=07e23c56-7835-4c96-b4bc-0325db947dd4)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b1127a-12c5-4b67-b419-b231d4fa1bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b1127a-12c5-4b67-b419-b231d4fa1bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6118302-5d3e-48fb-acaf-150f70b623e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6118302-5d3e-48fb-acaf-150f70b623e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69', 'volume_name': 'volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b895d14-9038-4a5a-8e49-82a6177cc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b895d14-9038-4a5a-8e49-82a6177cc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1fb2d3-1666-4f4a-b5cc-2d0f0c7d28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Volume 7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69', 'volume_size': 1} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8860439-e907-4c88-b954-1d599cb6f43d,created_at=2026-09-01T10:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080998095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8860439-e907-4c88-b954-1d599cb6f43d,host='devstack@QuobyteHD#QuobyteHD',id=7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:55Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e23c56-7835-4c96-b4bc-0325db947dd4),volume_type_id=07e23c56-7835-4c96-b4bc-0325db947dd4)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Creating volume 7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:55 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:39:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:55 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 1073741824 Sep 01 12:39:55 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:56 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 1073741824" returned: 0 in 0.735s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:56 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 Sep 01 12:39:56 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:56 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" returned: 0 in 0.369s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1fb2d3-1666-4f4a-b5cc-2d0f0c7d28a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1bd7f4-9595-4bfb-a9c1-b58b9ed7b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Volume volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 (7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69): created successfully Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1bd7f4-9595-4bfb-a9c1-b58b9ed7b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (ed554378-3d54-4a85-af89-f795a84fbb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-01cbb875-92af-455e-a969-d417453d7d0d tempest-GroupSnapshotsTest-421436963 None] Created volume successfully. Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (9817588f-62e5-463a-9b20-df101aac947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37acd79f-7add-47c2-97b9-4fc2702fafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37acd79f-7add-47c2-97b9-4fc2702fafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381102272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8860439-e907-4c88-b954-1d599cb6f43d,host='devstack@QuobyteHD#QuobyteHD',id=022d9e37-f40b-49d1-9da1-ba455611402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e23c56-7835-4c96-b4bc-0325db947dd4),volume_type_id=07e23c56-7835-4c96-b4bc-0325db947dd4)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b90221-e92c-4fa9-84a2-160790aed9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b90221-e92c-4fa9-84a2-160790aed9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe156ff-bae5-443d-86e0-6de4c3e7404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe156ff-bae5-443d-86e0-6de4c3e7404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022d9e37-f40b-49d1-9da1-ba455611402c', 'volume_name': 'volume-022d9e37-f40b-49d1-9da1-ba455611402c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ee65b8-ec3b-43de-b802-008acbe83b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ee65b8-ec3b-43de-b802-008acbe83b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10ac67-4241-419f-928e-7dc41907578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Volume 022d9e37-f40b-49d1-9da1-ba455611402c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022d9e37-f40b-49d1-9da1-ba455611402c', 'volume_size': 1} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8860439-e907-4c88-b954-1d599cb6f43d,created_at=2026-09-01T10:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-381102272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8860439-e907-4c88-b954-1d599cb6f43d,host='devstack@QuobyteHD#QuobyteHD',id=022d9e37-f40b-49d1-9da1-ba455611402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e23c56-7835-4c96-b4bc-0325db947dd4),volume_type_id=07e23c56-7835-4c96-b4bc-0325db947dd4)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Creating volume 022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:58 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:58 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c 1073741824 Sep 01 12:39:58 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (eba1665e-5f23-4ce8-9e49-8de19a75088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f026cd-94d2-43c4-a324-bba0d6e97c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f026cd-94d2-43c4-a324-bba0d6e97c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1064844623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178aa33e-988c-43e4-a4d4-8acd8b611ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a065167-f439-4353-887c-86c45fcfb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a065167-f439-4353-887c-86c45fcfb232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df59eb6-2ac7-40c1-9c4f-ff40241228dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df59eb6-2ac7-40c1-9c4f-ff40241228dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178aa33e-988c-43e4-a4d4-8acd8b611ba6', 'volume_name': 'volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6fba2f-236b-47b8-b345-20778434041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6fba2f-236b-47b8-b345-20778434041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99239d-2884-4989-bb45-d74f85e66918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Volume 178aa33e-988c-43e4-a4d4-8acd8b611ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6', 'volume_size': 1} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:59 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c 1073741824" returned: 0 in 0.597s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:59 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c Sep 01 12:39:59 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Flow 'volume_create_manager' (d624a580-7e80-4027-8136-3cb615c4e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8803d6c2-8638-4d7f-8c25-9844996fcf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8803d6c2-8638-4d7f-8c25-9844996fcf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-722470844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf9d4e-1f8a-42ce-9a29-9f3198f581e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff4bbed5c204294aa17676610635887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='4a00f95589af4571af34309d06127190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9fa325-19b5-4ba6-99cc-ca6a4edb50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9fa325-19b5-4ba6-99cc-ca6a4edb50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9af29c-a893-4819-b078-46e030945320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:39:59 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1064844623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178aa33e-988c-43e4-a4d4-8acd8b611ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Creating volume 178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:39:59 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb10ac67-4241-419f-928e-7dc41907578d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022d9e37-f40b-49d1-9da1-ba455611402c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfddf226-a099-40ae-a86e-f9fcf8c252fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:39:59 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 1073741824 Sep 01 12:39:59 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:39:59 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Volume volume-022d9e37-f40b-49d1-9da1-ba455611402c (022d9e37-f40b-49d1-9da1-ba455611402c): created successfully Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfddf226-a099-40ae-a86e-f9fcf8c252fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:39:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (9817588f-62e5-463a-9b20-df101aac947e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d6595b69-fbda-423c-8ff2-2a2d32740b7d tempest-GroupSnapshotsTest-421436963 None] Created volume successfully. Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a9af29c-a893-4819-b078-46e030945320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'volume_name': 'volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81cb873-f473-4ede-a4b4-1c94f4b7d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81cb873-f473-4ede-a4b4-1c94f4b7d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa3cac1-9e80-4d8b-a604-dc80a58a7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:00 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Trying to clone 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 from image 903fc775-9c21-408b-9650-9b60d3b1eb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:40:00 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:40:00 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 1073741824" returned: 0 in 0.821s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747f58a-199c-44ec-b6ed-301b355ce6d8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:00 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 Sep 01 12:40:00 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:00 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD Sep 01 12:40:00 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:01 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6" returned: 0 in 0.382s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99239d-2884-4989-bb45-d74f85e66918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:01 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0262101a-196e-4d5e-be08-dfac372f48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 is fetched for user 4a00f95589af4571af34309d06127190. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:40:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Volume volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 (178aa33e-988c-43e4-a4d4-8acd8b611ba6): created successfully Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0262101a-196e-4d5e-be08-dfac372f48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (eba1665e-5f23-4ce8-9e49-8de19a75088f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-86dfac00-72f7-4e0e-a8f4-99d410671a05 tempest-VolumesSnapshotTestJSON-535104592 None] Created volume successfully. Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d5ed7b-9edf-4c20-9e53-eef263f40cc1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:01 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD Sep 01 12:40:01 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-541c15e0-0b45-4904-b0ae-5123071bef36 tempest-GroupSnapshotsTest-421436963 None] Update group completed successfully. Sep 01 12:40:01 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-722470844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf9d4e-1f8a-42ce-9a29-9f3198f581e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff4bbed5c204294aa17676610635887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:39:59Z,use_quota=True,user_id='4a00f95589af4571af34309d06127190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Creating volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:01 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:01 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1073741824 Sep 01 12:40:01 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:02 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1073741824" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:02 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 Sep 01 12:40:02 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:02 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" returned: 0 in 0.293s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Attempting download of 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a58ad7-ed55-4289-86ec-59c896b4afc3]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_ {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Creating offline snapshot 5d9aac9a-8035-4afb-a9ac-e093182d33e6 of volume 178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a39b25-5785-458f-8841-d6df8451d5e4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:02 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_ Sep 01 12:40:02 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-50a3a6ed-db78-46eb-be34-6615b0266741 tempest-GroupSnapshotsTest-421436963 None] Update group completed successfully. Sep 01 12:40:02 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 Sep 01 12:40:02 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:02 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_" returned: 0 in 0.359s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_ {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:03 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_ Sep 01 12:40:03 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 1G Sep 01 12:40:03 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:03 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_" returned: 1 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_k3_o2ji_' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaece21-e794-4567-9a85-2dd057e0b132]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD Sep 01 12:40:03 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:03 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 1G" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 Sep 01 12:40:03 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:03 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] 903fc775-9c21-408b-9650-9b60d3b1eb91 was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 Sep 01 12:40:03 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:03 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:03 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 is being set with open permissions: ugo+rw Sep 01 12:40:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:03 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 Sep 01 12:40:03 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7c9e8d2c-57fd-44fa-95ab-3f5c05c9cd4e tempest-GroupSnapshotsTest-421436963 None] Update group completed successfully. Sep 01 12:40:04 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:04 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info Sep 01 12:40:04 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:04 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info" returned: 0 in 0.287s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:04 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info is being set with open permissions: ugo+rw Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:04 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info Sep 01 12:40:04 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:04 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.info" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fecd634b-2eaf-41cf-8bd1-3efe27883974 tempest-VolumesSnapshotTestJSON-535104592 None] Create snapshot completed successfully Sep 01 12:40:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b913791b-1265-4040-9a78-aabe85290fe7 tempest-GroupSnapshotsTest-421436963 None] Update group completed successfully. Sep 01 12:40:05 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" returned: 0 in 1.980s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:05 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cjk6opmldevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:40:05 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Converted 112.00 MB image at 56.55 MB/s Sep 01 12:40:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:05 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1G Sep 01 12:40:05 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-5d9aac9a-8035-4afb-a9ac-e093182d33e6-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-5d9aac9a-8035-4afb-a9ac-e093182d33e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-5d9aac9a-8035-4afb-a9ac-e093182d33e6" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-5d9aac9a-8035-4afb-a9ac-e093182d33e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Deleting offline snapshot 5d9aac9a-8035-4afb-a9ac-e093182d33e6 of volume 178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] snapshot_file for this snap is: volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:40:06 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 1G" returned: 0 in 0.435s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Downloaded image 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 for user 4a00f95589af4571af34309d06127190 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Marking volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9ca30-2d1c-4d0e-973a-c9044f885022]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Copying metadata from image 903fc775-9c21-408b-9650-9b60d3b1eb91 to 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Creating volume glance metadata for volume 08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 backed by image 903fc775-9c21-408b-9650-9b60d3b1eb91 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa3cac1-9e80-4d8b-a604-dc80a58a7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7841c-9296-4b50-9ecf-4ffb1336931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:06 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 Sep 01 12:40:06 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Volume volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 (08bf9d4e-1f8a-42ce-9a29-9f3198f581e7): created successfully Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7841c-9296-4b50-9ecf-4ffb1336931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Flow 'volume_create_manager' (d624a580-7e80-4027-8136-3cb615c4e801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8a190665-e8dc-40ee-8449-9076549ddecc tempest-ServerActionsTestOtherA-1430068175 None] Created volume successfully. Sep 01 12:40:06 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6" returned: 0 in 0.461s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0f0d7-5952-42fe-89f8-ebf7503b9806]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:06 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 Sep 01 12:40:06 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] GroupSnapshot 3e86534e-fffe-4951-828f-bd9560d7131d: creating. Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Group snapshot 3e86534e-fffe-4951-828f-bd9560d7131d: creating. {{(pid=87008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Creating offline snapshot 3332e2d3-34ae-44b0-afa5-c64246c5ce71 of volume 022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab9ce1-338d-494b-ad36-f24f26a9990e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:07 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c Sep 01 12:40:07 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:07 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6" returned: 0 in 0.614s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:07 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 Sep 01 12:40:07 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:07 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c" returned: 0 in 0.560s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:07 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 1G Sep 01 12:40:07 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:07 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6" returned: 0 in 0.533s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:07 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6 Sep 01 12:40:07 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:08 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6.5d9aac9a-8035-4afb-a9ac-e093182d33e6" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-5d9aac9a-8035-4afb-a9ac-e093182d33e6" released by "_delete_snapshot" :: held 2.069s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" released by "delete_snapshot" :: held 2.101s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:08 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:08 devstack cinder-volume[87008]: WARNING cinder.quota [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 1G" returned: 0 in 0.638s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022d9e37-f40b-49d1-9da1-ba455611402c -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['799062fb-64bc-46d6-93f2-b22ade7c3dda', '2fdd9db5-1b38-406c-80f5-015a040e30b6', '38292d95-f8ba-4252-8848-f5ce234e0891', '48283046-4fb8-457f-addd-455f2f3954f7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:08 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022d9e37-f40b-49d1-9da1-ba455611402c -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 Sep 01 12:40:08 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Delete snapshot completed successfully. Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7dbf93af-df5e-41a2-ba9f-f90ba1d5a98b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-5d9aac9a-8035-4afb-a9ac-e093182d33e6-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:08 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022d9e37-f40b-49d1-9da1-ba455611402c -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:08 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:08 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 Sep 01 12:40:08 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:08 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71" returned: 0 in 0.275s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:08 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info Sep 01 12:40:08 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:09 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:09 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:09 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info Sep 01 12:40:09 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:09 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.info" returned: 0 in 0.333s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Creating offline snapshot a19dca10-9f42-4506-881d-20d5a32eb272 of volume 7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be8193-e6c4-4c88-984f-55c04225da65]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:09 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 Sep 01 12:40:09 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:09 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (a1af9fab-5671-4b63-8bc1-713b0038c885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b500c0dc-3f95-4207-8597-3b7cc532106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b500c0dc-3f95-4207-8597-3b7cc532106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066152232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f289e-7d58-40bb-b3db-61583e329c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:10Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc28186-0b5d-4744-a20f-7b7f051e4e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc28186-0b5d-4744-a20f-7b7f051e4e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2f316f-3fec-434d-8914-a19e10a8848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2f316f-3fec-434d-8914-a19e10a8848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685f289e-7d58-40bb-b3db-61583e329c21', 'volume_name': 'volume-685f289e-7d58-40bb-b3db-61583e329c21', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4e77e2-eaac-4e18-9fa9-37812b79d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4e77e2-eaac-4e18-9fa9-37812b79d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aff5649-2524-49c4-a157-d2a5d8c9138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Volume 685f289e-7d58-40bb-b3db-61583e329c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685f289e-7d58-40bb-b3db-61583e329c21', 'volume_size': 1} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:10 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" returned: 0 in 0.569s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:10 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 1G Sep 01 12:40:10 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-59c88db6-4b5d-44d8-add4-2f80f3a08cc0 req-3c6916d4-6b42-4e19-bc48-99a6238675dc tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:10 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 1G" returned: 0 in 0.615s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:10 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 Sep 01 12:40:10 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:11 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:11 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:11 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 Sep 01 12:40:11 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:11 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:11 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info Sep 01 12:40:11 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:12 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info" returned: 0 in 0.497s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:12 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:12 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info Sep 01 12:40:12 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:12 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.info" returned: 0 in 0.302s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.375s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066152232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f289e-7d58-40bb-b3db-61583e329c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:10Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Creating volume 685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:12 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:12 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 1073741824 Sep 01 12:40:12 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f283933e-1e2b-4644-9f4e-2cdce637de33 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 3e86534e-fffe-4951-828f-bd9560d7131d: created successfully Sep 01 12:40:13 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 1073741824" returned: 0 in 0.628s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:13 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:13 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] group_snapshot 3e86534e-fffe-4951-828f-bd9560d7131d: deleting Sep 01 12:40:13 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 0.373s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-59c88db6-4b5d-44d8-add4-2f80f3a08cc0 req-3c6916d4-6b42-4e19-bc48-99a6238675dc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.825s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] group_snapshot 3e86534e-fffe-4951-828f-bd9560d7131d: deleting {{(pid=87008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aff5649-2524-49c4-a157-d2a5d8c9138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685f289e-7d58-40bb-b3db-61583e329c21', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f78ecbc-0ed5-4e04-b960-d6afcb37c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-59c88db6-4b5d-44d8-add4-2f80f3a08cc0 req-3c6916d4-6b42-4e19-bc48-99a6238675dc tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.131s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:13 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Volume volume-685f289e-7d58-40bb-b3db-61583e329c21 (685f289e-7d58-40bb-b3db-61583e329c21): created successfully Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f78ecbc-0ed5-4e04-b960-d6afcb37c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (a1af9fab-5671-4b63-8bc1-713b0038c885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2f007485-568d-4773-927e-46d1ffea6157 tempest-VolumesSnapshotTestJSON-535104592 None] Created volume successfully. Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-3332e2d3-34ae-44b0-afa5-c64246c5ce71" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3332e2d3-34ae-44b0-afa5-c64246c5ce71" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Deleting offline snapshot 3332e2d3-34ae-44b0-afa5-c64246c5ce71 of volume 022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] snapshot_file for this snap is: volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-59c88db6-4b5d-44d8-add4-2f80f3a08cc0 req-3c6916d4-6b42-4e19-bc48-99a6238675dc tempest-ServerActionsTestOtherA-1430068175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '256c104c-b3e2-465f-86c3-fa597c069f72', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6e9b7e-3b09-433c-8e69-ef74226b0a17]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-59c88db6-4b5d-44d8-add4-2f80f3a08cc0 req-3c6916d4-6b42-4e19-bc48-99a6238675dc tempest-ServerActionsTestOtherA-1430068175 None] attachment_update completed successfully. Sep 01 12:40:14 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 Sep 01 12:40:14 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:14 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71" returned: 0 in 0.644s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-022d9e37-f40b-49d1-9da1-ba455611402c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[de514ef4-e385-4f01-be7e-06035de4b0cc]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Creating offline snapshot 9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 of volume 685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[811bad46-4898-4dc9-a2dc-16cd77d576bb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:14 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c Sep 01 12:40:14 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:14 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:14 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:15 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c" returned: 0 in 0.815s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:15 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 Sep 01 12:40:15 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:15 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 0.818s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:15 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 1G Sep 01 12:40:15 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:16 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71" returned: 0 in 1.080s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:16 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 1G" returned: 0 in 0.973s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f289e-7d58-40bb-b3db-61583e329c21 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:16 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71 Sep 01 12:40:16 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:16 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f289e-7d58-40bb-b3db-61583e329c21 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:16 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:16 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c.3332e2d3-34ae-44b0-afa5-c64246c5ce71" returned: 0 in 0.521s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3332e2d3-34ae-44b0-afa5-c64246c5ce71" released by "_delete_snapshot" :: held 3.258s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" released by "delete_snapshot" :: held 3.315s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-a19dca10-9f42-4506-881d-20d5a32eb272" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-a19dca10-9f42-4506-881d-20d5a32eb272" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Deleting offline snapshot a19dca10-9f42-4506-881d-20d5a32eb272 of volume 7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] snapshot_file for this snap is: volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:40:17 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685f289e-7d58-40bb-b3db-61583e329c21 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.821s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:17 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 is being set with open permissions: ugo+rw Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd97fa-af54-4306-9b38-22c4837b1996]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:17 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:17 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:17 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 Sep 01 12:40:17 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:18 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.901s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:18 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272" returned: 0 in 0.942s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ccbb13-11a3-4817-bd58-a3b5f161fa30]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:18 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info Sep 01 12:40:18 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:18 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 Sep 01 12:40:18 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:19 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info" returned: 0 in 0.801s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:19 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info is being set with open permissions: ugo+rw Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:19 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info Sep 01 12:40:19 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:19 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" returned: 0 in 1.020s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:19 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 Sep 01 12:40:19 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:19 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.info" returned: 0 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.083s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-60164cfc-50da-4deb-b571-e5fa38b754c2 tempest-VolumesSnapshotTestJSON-535104592 None] Create snapshot completed successfully Sep 01 12:40:20 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272" returned: 0 in 0.901s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:20 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272 Sep 01 12:40:20 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:20 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69.a19dca10-9f42-4506-881d-20d5a32eb272" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-a19dca10-9f42-4506-881d-20d5a32eb272" released by "_delete_snapshot" :: held 3.597s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" released by "delete_snapshot" :: held 3.673s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:21 devstack cinder-volume[87008]: WARNING cinder.quota [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-442225323 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-442225323, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:21 devstack cinder-volume[87008]: WARNING cinder.quota [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-442225323 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-442225323, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Created reservations ['9acfc555-2b63-44b3-b675-3bdd17422dda', '7acf3fdd-479c-41f5-994f-d6fcdbbb7135', 'e8aed655-aa92-4665-967c-96fc103fcd49', '32107605-68b4-4fcd-886a-be2be708a803'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] Created reservations ['16580a9a-54b0-404f-9e88-8ce3224643e9', '04ee8711-a4e3-48b0-9952-d38282c38b40', '485682c5-acef-46ac-a580-64ff551aa2f3', 'f77d96aa-a4aa-4f11-a109-92114ad3839f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (107af9ea-636d-40cb-9cf7-42600a65fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2a2f19-8641-4acd-b72c-75f9b6abfd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2a2f19-8641-4acd-b72c-75f9b6abfd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-149120586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3989d8-4113-4ee7-b9d8-02d67796d233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:21Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c707598-c30a-4c33-9de2-a35e583efe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c707598-c30a-4c33-9de2-a35e583efe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b167d69-6713-444e-81dd-0b9b7b3f0bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b167d69-6713-444e-81dd-0b9b7b3f0bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c3989d8-4113-4ee7-b9d8-02d67796d233', 'volume_name': 'volume-2c3989d8-4113-4ee7-b9d8-02d67796d233', 'volume_size': 2, 'snapshot_id': '9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720cf2a-6950-489d-81dd-d8005877ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1720cf2a-6950-489d-81dd-d8005877ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd33697-63dc-46b7-951e-adcc4468eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Volume 2c3989d8-4113-4ee7-b9d8-02d67796d233: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c3989d8-4113-4ee7-b9d8-02d67796d233', 'volume_size': 2, 'snapshot_id': '9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6'} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-2c3989d8-4113-4ee7-b9d8-02d67796d233" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-2c3989d8-4113-4ee7-b9d8-02d67796d233" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Creating volume 2c3989d8-4113-4ee7-b9d8-02d67796d233 from snapshot 9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] snapshot: 9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6, volume: 2c3989d8-4113-4ee7-b9d8-02d67796d233, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:40:21 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a61f1fc3-b6dc-4791-b29e-e771ee107dde tempest-GroupSnapshotsTest-421436963 None] group_snapshot 3e86534e-fffe-4951-828f-bd9560d7131d: deleted successfully Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb12760-80ac-4054-a91d-ed6408476582]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:22 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:22 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:22 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.775s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685f289e-7d58-40bb-b3db-61583e329c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[55447706-4853-4505-ae49-eb8a69cf665b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:23 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:23 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:23 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 1.067s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:40:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:40:23 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:40:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:24 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 Sep 01 12:40:24 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" acquired by "delete_volume" :: waited 0.099s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3121c31b-dcb6-4ccb-b2be-591a38f55f6e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:24 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c Sep 01 12:40:24 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:26 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c" returned: 0 in 1.590s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:26 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c Sep 01 12:40:26 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:26 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:40:26 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:26 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-022d9e37-f40b-49d1-9da1-ba455611402c" returned: 0 in 0.870s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-022d9e37-f40b-49d1-9da1-ba455611402c" released by "delete_volume" :: held 2.707s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" acquired by "delete_volume" :: waited 0.095s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bbdae-9a48-4ea9-8c6f-dfa9ab57376d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:27 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 Sep 01 12:40:27 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:28 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 1.550s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:28 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:40:28 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:40:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:40:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:40:29 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" returned: 0 in 2.630s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:30 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69 Sep 01 12:40:30 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:31 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" returned: 0 in 1.619s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-7fa6d6cc-e5a2-4c26-b16b-c83dc8323c69" released by "delete_volume" :: held 4.574s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:31 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=90,cinder:SELECT=121,cinder:INSERT=24,cinder:DELETE=2 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:40:31 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=120,cinder:UPDATE=96,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:40:32 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Created reservations ['59871578-4b3d-4ab4-8d6c-51603c1b38e5'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:32 devstack cinder-volume[87008]: WARNING cinder.quota [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-442225323 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-442225323, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:32 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Created reservations ['e834a180-87a0-4f26-b779-30142d02d2d6', 'd534d34c-5bc8-4509-b03a-768fa8be725c', '4639ae9f-c00f-4122-801d-16cc9ac57c5b', 'f3b84f04-d3e8-486e-b980-e43c706b379f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:33 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Created reservations ['ad9605e2-35f1-4d7f-a87c-9980e50a897c', '49521cb2-e9fc-4999-8489-b50b9433abad', '13580a59-360c-4323-9d91-320e8227e90b', 'ccf33938-b034-4ced-9d42-815fbccee4a5'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:35 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:40:35 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:35 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233" returned: 0 in 11.250s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21, size 1024.00 MB, duration 11.25 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:40:35 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Converted 1024.00 MB image at 91.00 MB/s Sep 01 12:40:35 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 is being set with open permissions: ugo+rw Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:35 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 Sep 01 12:40:35 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:35 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.394s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:40:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-062c9f2a-2119-4128-8f9d-04d46bf096ba tempest-GroupSnapshotsTest-421436963 None] Delete group completed successfully. Sep 01 12:40:35 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" released by "_copy_volume_from_snapshot" :: held 13.546s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-2c3989d8-4113-4ee7-b9d8-02d67796d233" released by "_create_volume_from_snapshot" :: held 13.659s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.723s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd33697-63dc-46b7-951e-adcc4468eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3989d8-4113-4ee7-b9d8-02d67796d233', 'volume_size': 2, 'snapshot_id': '9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c06b9f-cb2e-4473-bd22-c099287f8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Volume volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 (2c3989d8-4113-4ee7-b9d8-02d67796d233): created successfully Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c06b9f-cb2e-4473-bd22-c099287f8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (107af9ea-636d-40cb-9cf7-42600a65fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b7f891de-d062-40c5-aa14-6e45f394b031 tempest-VolumesSnapshotTestJSON-535104592 None] Created volume successfully. Sep 01 12:40:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-2c3989d8-4113-4ee7-b9d8-02d67796d233-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-2c3989d8-4113-4ee7-b9d8-02d67796d233-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e51e467-79c5-4a84-a3f5-a451de298f7e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:36 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 Sep 01 12:40:36 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea83cba2-a747-4d7a-af4e-0e59cf2d0191 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-552434417: creating Sep 01 12:40:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea83cba2-a747-4d7a-af4e-0e59cf2d0191 tempest-GroupSnapshotsTest-421436963 None] Group tempest-GroupSnapshotsTest-Group-552434417: created successfully Sep 01 12:40:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea83cba2-a747-4d7a-af4e-0e59cf2d0191 tempest-GroupSnapshotsTest-421436963 None] Create group completed successfully. Sep 01 12:40:36 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:36 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233 Sep 01 12:40:36 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:36 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c3989d8-4113-4ee7-b9d8-02d67796d233" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-2c3989d8-4113-4ee7-b9d8-02d67796d233" released by "delete_volume" :: held 0.799s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['0e447d94-5f0d-49f7-abcd-4879cc60763d', '57caacaa-ee98-48a9-84b3-0599b2a40142', '0a228a10-4d85-4283-86a2-e72ded010b7f', '8c57e960-1eb1-431c-af5b-83082b3db56a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:37 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:40:37 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:37 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:40:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Deleted volume successfully. Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-25285874-4994-4507-ac47-8c7eff19aa78 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-2c3989d8-4113-4ee7-b9d8-02d67796d233-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-c6804ef6-31a5-4c46-921e-d6327572929b req-ecf90212-2d0c-4fa3-9e24-2d017b490fae tempest-ServerActionsTestOtherA-1430068175 None] Terminate volume connection completed successfully. Sep 01 12:40:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-c6804ef6-31a5-4c46-921e-d6327572929b req-ecf90212-2d0c-4fa3-9e24-2d017b490fae tempest-ServerActionsTestOtherA-1430068175 None] Deleting attachment 256c104c-b3e2-465f-86c3-fa597c069f72. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (8b01d0d1-dbb7-4439-a018-5d80c5e40e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1a8229-fec4-4280-9245-0c6b9e22018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1a8229-fec4-4280-9245-0c6b9e22018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764122606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e7bfd3b-ff9d-462e-94ec-28cf53d955cd,host='devstack@QuobyteHD#QuobyteHD',id=3e62caa2-668c-4fba-ac6b-23a5d8210761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:38Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a928642-de4a-4631-91a8-ed172370b21c),volume_type_id=5a928642-de4a-4631-91a8-ed172370b21c)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8ea111-8993-4048-9b45-e6120be94293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8ea111-8993-4048-9b45-e6120be94293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693e5ced-9aa7-48d5-b392-8432614f2150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693e5ced-9aa7-48d5-b392-8432614f2150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e62caa2-668c-4fba-ac6b-23a5d8210761', 'volume_name': 'volume-3e62caa2-668c-4fba-ac6b-23a5d8210761', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23b72a1-5931-477f-a285-3e2110460a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23b72a1-5931-477f-a285-3e2110460a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137f7549-1880-4860-90b7-c1988923dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:38 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Volume 3e62caa2-668c-4fba-ac6b-23a5d8210761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e62caa2-668c-4fba-ac6b-23a5d8210761', 'volume_size': 1} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e7bfd3b-ff9d-462e-94ec-28cf53d955cd,created_at=2026-09-01T10:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764122606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e7bfd3b-ff9d-462e-94ec-28cf53d955cd,host='devstack@QuobyteHD#QuobyteHD',id=3e62caa2-668c-4fba-ac6b-23a5d8210761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed1d40a15ac4be4bcae2efc2f4a0f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:38Z,use_quota=True,user_id='de3898c635d74e81ac5ab75f16a8aae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a928642-de4a-4631-91a8-ed172370b21c),volume_type_id=5a928642-de4a-4631-91a8-ed172370b21c)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Creating volume 3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" acquired by "delete_snapshot" :: waited 0.117s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:38 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 1073741824 Sep 01 12:40:38 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Deleting offline snapshot 9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 of volume 685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] snapshot_file for this snap is: volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c68fb7-9245-4c1b-bc48-341bc60c0c71]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:38 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:38 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:39 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 1073741824" returned: 0 in 0.567s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:39 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 Sep 01 12:40:39 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:39 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.538s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685f289e-7d58-40bb-b3db-61583e329c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa4dc5f-4828-47cd-a228-5514bf96b86e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:39 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:39 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:39 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761" returned: 0 in 0.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137f7549-1880-4860-90b7-c1988923dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e62caa2-668c-4fba-ac6b-23a5d8210761', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69364715-181f-49de-8c25-d08aa43d619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Volume volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 (3e62caa2-668c-4fba-ac6b-23a5d8210761): created successfully Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69364715-181f-49de-8c25-d08aa43d619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Flow 'volume_create_manager' (8b01d0d1-dbb7-4439-a018-5d80c5e40e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a66bed97-87f6-4e56-87b3-a33f3bac197e tempest-GroupSnapshotsTest-421436963 None] Created volume successfully. Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-c6804ef6-31a5-4c46-921e-d6327572929b req-93370a6a-07ec-4130-b259-50efc1982f7d tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-c6804ef6-31a5-4c46-921e-d6327572929b req-93370a6a-07ec-4130-b259-50efc1982f7d tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:39 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 0.625s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-c6804ef6-31a5-4c46-921e-d6327572929b req-93370a6a-07ec-4130-b259-50efc1982f7d tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:39 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:39 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-c6804ef6-31a5-4c46-921e-d6327572929b req-93370a6a-07ec-4130-b259-50efc1982f7d tempest-ServerActionsTestOtherA-1430068175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2facd91-4f92-4746-843e-2b023ece2ea4', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:40:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-c6804ef6-31a5-4c46-921e-d6327572929b req-93370a6a-07ec-4130-b259-50efc1982f7d tempest-ServerActionsTestOtherA-1430068175 None] attachment_update completed successfully. Sep 01 12:40:40 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.440s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:40 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6 Sep 01 12:40:40 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:40 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21.9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" returned: 0 in 0.330s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6" released by "_delete_snapshot" :: held 2.119s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" released by "delete_snapshot" :: held 2.154s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['a04ce857-d38a-4537-a671-ef2044372cd1', '0a06a253-8c3d-461e-bbbe-d9369adc60f1', '59be34fe-9fd3-4a9a-946d-8fb55751afcc', '1ce4b828-47f2-44a7-9915-a7c7882d2940'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Delete snapshot completed successfully. Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e404881c-88c0-4e19-be76-af40696e5e2f tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-9b4a9d9d-9f0a-4279-a9ce-292c86ba70c6-delete_snapshot" released by "delete_snapshot" :: held 2.652s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] GroupSnapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: creating. Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Group snapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: creating. {{(pid=87008) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Creating offline snapshot 8b889ddc-585f-4749-bd41-5c4cedde83f8 of volume 3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df1d1e-eccd-48cf-8afc-3097d990896d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:41 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 Sep 01 12:40:41 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-685f289e-7d58-40bb-b3db-61583e329c21-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-685f289e-7d58-40bb-b3db-61583e329c21-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc12817-71a0-4ef8-9ae3-fc8d306314a3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:42 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761" returned: 0 in 0.805s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:42 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:42 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:42 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 1G Sep 01 12:40:42 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:42 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 0.497s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:42 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21 Sep 01 12:40:42 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:42 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 1G" returned: 0 in 0.622s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:42 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 Sep 01 12:40:42 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:43 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-685f289e-7d58-40bb-b3db-61583e329c21" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-685f289e-7d58-40bb-b3db-61583e329c21" released by "delete_volume" :: held 1.049s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['5e6c4ab6-d126-494a-8fbf-6de96130bf53', 'cef3d051-567e-487e-afac-c9c2e36f0b76', '9c70618a-3ee8-4100-86d8-96dbc8fbcad0', '17d11a3d-87fa-439b-b24a-dff0d0715cb8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:43 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:40:43 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:43 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8" returned: 0 in 0.681s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:43 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:43 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 Sep 01 12:40:43 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:44 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.625s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:40:44 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Deleted volume successfully. Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8" returned: 0 in 0.578s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-69869ee8-207f-4ca3-8925-d53714209501 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-685f289e-7d58-40bb-b3db-61583e329c21-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:44 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info Sep 01 12:40:44 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (9427d998-dd30-4d1d-afb3-9b2243f0935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6986233c-8dfe-4a3d-82f5-12f6066a08e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6986233c-8dfe-4a3d-82f5-12f6066a08e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540489323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f05abf9-53d5-4da6-954b-97611ee6eb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:44Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1824189c-93da-4d82-bd77-c83e7d253813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1824189c-93da-4d82-bd77-c83e7d253813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2cb4a0-896e-4493-8cc5-266e3b343c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2cb4a0-896e-4493-8cc5-266e3b343c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f05abf9-53d5-4da6-954b-97611ee6eb55', 'volume_name': 'volume-9f05abf9-53d5-4da6-954b-97611ee6eb55', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab76d32-2a2a-4940-898c-bee64b250629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab76d32-2a2a-4940-898c-bee64b250629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f754d5a-e416-4931-996c-c345dbc4d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:44 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Volume 9f05abf9-53d5-4da6-954b-97611ee6eb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f05abf9-53d5-4da6-954b-97611ee6eb55', 'volume_size': 1} Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:44 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info" returned: 0 in 0.509s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:44 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 12:40:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:44 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info Sep 01 12:40:44 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:45 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.info" returned: 0 in 0.494s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.864s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540489323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f05abf9-53d5-4da6-954b-97611ee6eb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:44Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Creating volume 9f05abf9-53d5-4da6-954b-97611ee6eb55 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:45 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:45 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 1073741824 Sep 01 12:40:45 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:45 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-77586465-f456-41a0-93b5-103170f538a0 tempest-GroupSnapshotsTest-421436963 None] group_snapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: created successfully Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (36a43071-476d-4f55-b626-bba9f72deedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cb906-5467-4aa0-a30e-0928e71bd274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cb906-5467-4aa0-a30e-0928e71bd274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572985868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0115b9d9-11b9-4602-81d2-e5a15d2331cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:45Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abc6f45-88dd-4513-887b-bf0722272573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abc6f45-88dd-4513-887b-bf0722272573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c260f6ba-cdd4-41fb-affa-4bb85f32c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c260f6ba-cdd4-41fb-affa-4bb85f32c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0115b9d9-11b9-4602-81d2-e5a15d2331cc', 'volume_name': 'volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d36bb-88fd-44a3-b0bd-c1e8c831e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d36bb-88fd-44a3-b0bd-c1e8c831e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f0787d-7568-4e43-803a-3f4ae94fc5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:45 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Volume 0115b9d9-11b9-4602-81d2-e5a15d2331cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc', 'volume_size': 1} Sep 01 12:40:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] group_snapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: deleting Sep 01 12:40:46 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 1073741824" returned: 0 in 0.792s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] group_snapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: deleting {{(pid=87008) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-8b889ddc-585f-4749-bd41-5c4cedde83f8" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-8b889ddc-585f-4749-bd41-5c4cedde83f8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Deleting offline snapshot 8b889ddc-585f-4749-bd41-5c4cedde83f8 of volume 3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:40:46 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 Sep 01 12:40:46 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] snapshot_file for this snap is: volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97af48c-ef58-427c-97de-4b3f9aeb1677]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:46 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 Sep 01 12:40:46 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:46 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55" returned: 0 in 0.403s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572985868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0115b9d9-11b9-4602-81d2-e5a15d2331cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:45Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Creating volume 0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:46 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f754d5a-e416-4931-996c-c345dbc4d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f05abf9-53d5-4da6-954b-97611ee6eb55', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:46 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc 1073741824 Sep 01 12:40:46 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5005581-a990-4ec7-ab10-1340a30a4539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:46 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Volume volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 (9f05abf9-53d5-4da6-954b-97611ee6eb55): created successfully Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5005581-a990-4ec7-ab10-1340a30a4539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (9427d998-dd30-4d1d-afb3-9b2243f0935d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1df664d5-cb69-4693-a083-f51ea60899fd tempest-AttachVolumeTestJSON-1935244478 None] Created volume successfully. Sep 01 12:40:47 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8" returned: 0 in 0.784s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e62caa2-668c-4fba-ac6b-23a5d8210761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c86f8b-eeea-46a4-95f6-07681c08b126]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:47 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 Sep 01 12:40:47 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:47 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc 1073741824" returned: 0 in 0.683s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:47 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:40:47 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:47 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:47 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761" returned: 0 in 0.605s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:47 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 Sep 01 12:40:47 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f0787d-7568-4e43-803a-3f4ae94fc5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2356a3b3-3af4-4310-8798-d175a7c8d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:47 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Volume volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc (0115b9d9-11b9-4602-81d2-e5a15d2331cc): created successfully Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2356a3b3-3af4-4310-8798-d175a7c8d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (36a43071-476d-4f55-b626-bba9f72deedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-226151d8-cc77-433c-a12b-ae465aae17b4 tempest-VolumesSnapshotTestJSON-535104592 None] Created volume successfully. Sep 01 12:40:48 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8" returned: 0 in 0.574s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:48 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8 Sep 01 12:40:48 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-4acd20dc-0c61-4a17-98b6-1125adfbdf8f req-27a25272-ca6f-4020-85b3-faca2e34bd3b tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-4acd20dc-0c61-4a17-98b6-1125adfbdf8f req-27a25272-ca6f-4020-85b3-faca2e34bd3b tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-4acd20dc-0c61-4a17-98b6-1125adfbdf8f req-27a25272-ca6f-4020-85b3-faca2e34bd3b tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-4acd20dc-0c61-4a17-98b6-1125adfbdf8f req-27a25272-ca6f-4020-85b3-faca2e34bd3b tempest-AttachVolumeTestJSON-1935244478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-9f05abf9-53d5-4da6-954b-97611ee6eb55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c561dae4-bb5f-4bfe-af10-1d87e3eb11a1', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:40:48 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761.8b889ddc-585f-4749-bd41-5c4cedde83f8" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-8b889ddc-585f-4749-bd41-5c4cedde83f8" released by "_delete_snapshot" :: held 2.445s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" released by "delete_snapshot" :: held 2.477s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-4acd20dc-0c61-4a17-98b6-1125adfbdf8f req-27a25272-ca6f-4020-85b3-faca2e34bd3b tempest-AttachVolumeTestJSON-1935244478 None] attachment_update completed successfully. Sep 01 12:40:48 devstack cinder-volume[87008]: WARNING cinder.quota [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1232315004 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1232315004, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:48 devstack cinder-volume[87008]: WARNING cinder.quota [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1232315004 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1232315004, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:48 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] Created reservations ['200690cc-e6d1-4407-aaf3-abd539026cce', '77e087c9-6bf4-40ca-8beb-e05d1b412ffc', '7d09c86a-e068-4776-a10c-506ad19f36b4', 'd32dacf1-d3e0-4fd5-b7fb-15573ae5dd4c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-44cf931b-110d-403e-9af5-eb48097f3a2f tempest-GroupSnapshotsTest-421436963 None] group_snapshot 935118c1-330a-416e-bfa0-8fc04d5102bc: deleted successfully Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Creating offline snapshot dde7833d-9c9e-4eec-a897-f4b98c879875 of volume 0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211f4fd-c4c5-4589-a7d5-76100047d04a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:49 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:40:49 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:49 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.447s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:49 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 1G Sep 01 12:40:49 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:49 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 1G" returned: 0 in 0.456s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:40:50 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a4e86-0c12-43d5-931c-b75d6743a185]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 Sep 01 12:40:50 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:50 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.332s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 is being set with open permissions: ugo+rw Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:40:50 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:50 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.248s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761 Sep 01 12:40:50 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info Sep 01 12:40:50 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:50 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3e62caa2-668c-4fba-ac6b-23a5d8210761" returned: 0 in 0.341s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:50 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info is being set with open permissions: ugo+rw Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Lock "cinder-quobyte-3e62caa2-668c-4fba-ac6b-23a5d8210761" released by "delete_volume" :: held 0.853s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:40:51 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info Sep 01 12:40:51 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Created reservations ['74145b84-1dfb-4775-8849-e73b90af6128'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:51 devstack cinder-volume[87008]: WARNING cinder.quota [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1232315004 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1232315004, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Created reservations ['b2cded73-054d-4f51-9cb1-1a0b9f5d47fd', '9397d1ce-e69b-4dee-b34d-af8532cdf42a', '41d5c662-f71f-4858-b9bc-c694e3c5a0ba', 'ac6f3df0-4b67-4146-9683-b6ccb5e0e1a5'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:40:51 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.info" returned: 0 in 0.470s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:51 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:40:51 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (464c97b8-53bc-4727-a90b-8273ba205f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5f363-6ca4-44b9-8bec-1c009132d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5f363-6ca4-44b9-8bec-1c009132d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-595680165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc8e3d5-1b66-49e5-8137-24fec6106950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:51Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fafbe6-3d31-4df9-af12-cfc242b690d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fafbe6-3d31-4df9-af12-cfc242b690d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e3b6fc-95fa-4d69-a517-d1046f82c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e3b6fc-95fa-4d69-a517-d1046f82c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc8e3d5-1b66-49e5-8137-24fec6106950', 'volume_name': 'volume-1cc8e3d5-1b66-49e5-8137-24fec6106950', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94ea974-69aa-4e71-ab3a-242ee575b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94ea974-69aa-4e71-ab3a-242ee575b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93eabf7-b5e5-400b-867c-29d31f3d3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:51 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Volume 1cc8e3d5-1b66-49e5-8137-24fec6106950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc8e3d5-1b66-49e5-8137-24fec6106950', 'volume_size': 1} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-595680165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc8e3d5-1b66-49e5-8137-24fec6106950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb0cb085d0b40a8b9b07d2820904013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:51Z,use_quota=True,user_id='0167c4b85def4477b30a70c89fae3c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Creating volume 1cc8e3d5-1b66-49e5-8137-24fec6106950 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:51 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f8552102-eb64-4bad-9363-cdef61a4078c tempest-VolumesSnapshotTestJSON-535104592 None] Create snapshot completed successfully Sep 01 12:40:51 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 1073741824 Sep 01 12:40:51 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:51 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:51 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:40:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8414c267-2516-4304-a085-3befeede41fd tempest-GroupSnapshotsTest-421436963 None] Delete group completed successfully. Sep 01 12:40:52 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 1073741824" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:52 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 Sep 01 12:40:52 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:52 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93eabf7-b5e5-400b-867c-29d31f3d3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc8e3d5-1b66-49e5-8137-24fec6106950', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e19113-24c2-430c-8145-90d808265562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Volume volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 (1cc8e3d5-1b66-49e5-8137-24fec6106950): created successfully Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e19113-24c2-430c-8145-90d808265562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Flow 'volume_create_manager' (464c97b8-53bc-4727-a90b-8273ba205f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b287e9c4-2cf1-4109-8595-7b2ab4e2e2a8 tempest-AttachVolumeTestJSON-1935244478 None] Created volume successfully. Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (9e12c45a-5021-4180-a372-dafb3a3b3910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdaea6b-abc0-4d92-bc3b-01c40d663b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdaea6b-abc0-4d92-bc3b-01c40d663b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1154673529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7468cef9-945a-43b0-9504-8a93b27d7def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd35a5703f344e4aa9155fc315368dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dde7833d-9c9e-4eec-a897-f4b98c879875,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:40:53Z,use_quota=True,user_id='b792c3f52e4b45079cb21cc576e688f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c357a0-7ea8-4fa3-bedb-1e78fe37a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c357a0-7ea8-4fa3-bedb-1e78fe37a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3527d3-5655-4967-8d3c-09e0de79944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3527d3-5655-4967-8d3c-09e0de79944a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7468cef9-945a-43b0-9504-8a93b27d7def', 'volume_name': 'volume-7468cef9-945a-43b0-9504-8a93b27d7def', 'volume_size': 1, 'snapshot_id': 'dde7833d-9c9e-4eec-a897-f4b98c879875'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb1734-793d-47ce-9805-a0539856dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb1734-793d-47ce-9805-a0539856dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55963439-9f0b-4f54-8bde-48521d981152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:40:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Volume 7468cef9-945a-43b0-9504-8a93b27d7def: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7468cef9-945a-43b0-9504-8a93b27d7def', 'volume_size': 1, 'snapshot_id': 'dde7833d-9c9e-4eec-a897-f4b98c879875'} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875-7468cef9-945a-43b0-9504-8a93b27d7def" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875-7468cef9-945a-43b0-9504-8a93b27d7def" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Creating volume 7468cef9-945a-43b0-9504-8a93b27d7def from snapshot dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] snapshot: dde7833d-9c9e-4eec-a897-f4b98c879875, volume: 7468cef9-945a-43b0-9504-8a93b27d7def, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9519c096-ee8f-42e6-849e-624a3f97eb70]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:53 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:40:53 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:53 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195315f-6c38-4434-a6cc-bf56de6dc578]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:40:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:53 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:40:53 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:54 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.641s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:40:54 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def Sep 01 12:40:54 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:40:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9f0b4fe2-4011-4e88-9882-f2bc02eeb747 req-1a615cd1-9332-4e40-8915-eae388f7fa34 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:00 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def" returned: 0 in 6.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:00 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:41:00 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Converted 1024.00 MB image at 159.47 MB/s Sep 01 12:41:00 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def is being set with open permissions: ugo+rw Sep 01 12:41:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:00 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def Sep 01 12:41:00 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:00 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" released by "_copy_volume_from_snapshot" :: held 7.921s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875-7468cef9-945a-43b0-9504-8a93b27d7def" released by "_create_volume_from_snapshot" :: held 7.996s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.016s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9f0b4fe2-4011-4e88-9882-f2bc02eeb747 req-1a615cd1-9332-4e40-8915-eae388f7fa34 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.378s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9f0b4fe2-4011-4e88-9882-f2bc02eeb747 req-1a615cd1-9332-4e40-8915-eae388f7fa34 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55963439-9f0b-4f54-8bde-48521d981152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7468cef9-945a-43b0-9504-8a93b27d7def', 'volume_size': 1, 'snapshot_id': 'dde7833d-9c9e-4eec-a897-f4b98c879875'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1dfcf8-d62c-4fe1-809c-d82e13f5361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Volume volume-7468cef9-945a-43b0-9504-8a93b27d7def (7468cef9-945a-43b0-9504-8a93b27d7def): created successfully Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1dfcf8-d62c-4fe1-809c-d82e13f5361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Flow 'volume_create_manager' (9e12c45a-5021-4180-a372-dafb3a3b3910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-9f0b4fe2-4011-4e88-9882-f2bc02eeb747 req-1a615cd1-9332-4e40-8915-eae388f7fa34 tempest-AttachVolumeTestJSON-1935244478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-1cc8e3d5-1b66-49e5-8137-24fec6106950', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '321bf277-4d72-47c9-8900-0c54bc686719', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:41:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-76692509-b17e-4196-af23-a843d078e226 tempest-VolumesSnapshotTestJSON-535104592 None] Created volume successfully. Sep 01 12:41:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-9f0b4fe2-4011-4e88-9882-f2bc02eeb747 req-1a615cd1-9332-4e40-8915-eae388f7fa34 tempest-AttachVolumeTestJSON-1935244478 None] attachment_update completed successfully. Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-7468cef9-945a-43b0-9504-8a93b27d7def-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-7468cef9-945a-43b0-9504-8a93b27d7def-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640dc9f-4b0a-435d-a055-3c51e8b7fe8d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:02 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def Sep 01 12:41:02 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-27ba2c80-8161-4ff7-90c3-07a1dba0ab1b tempest-GroupsTest-229003661 None] Group tempest-Group1-42251400: creating Sep 01 12:41:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-27ba2c80-8161-4ff7-90c3-07a1dba0ab1b tempest-GroupsTest-229003661 None] Group tempest-Group1-42251400: created successfully Sep 01 12:41:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-27ba2c80-8161-4ff7-90c3-07a1dba0ab1b tempest-GroupsTest-229003661 None] Create group completed successfully. Sep 01 12:41:02 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:02 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def Sep 01 12:41:02 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:02 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7468cef9-945a-43b0-9504-8a93b27d7def" returned: 0 in 0.275s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-7468cef9-945a-43b0-9504-8a93b27d7def" released by "delete_volume" :: held 0.785s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['0f1af5aa-8416-4389-8bff-76f38ca3b9d5', 'ca8b87a6-4393-4c10-a4d8-5cf2d212d20f', 'e291abc1-97b2-478b-bcbb-814cfd1ac8cb', '4c77dd9f-6fb2-4d95-ac9d-95b5b70cca57'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:02 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:02 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-305f4ee9-8acc-46b9-85ae-d64915f65af0 req-e54d27f7-6038-4c64-b104-fab6393e56d1 tempest-AttachVolumeTestJSON-1935244478 None] Terminate volume connection completed successfully. Sep 01 12:41:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-305f4ee9-8acc-46b9-85ae-d64915f65af0 req-e54d27f7-6038-4c64-b104-fab6393e56d1 tempest-AttachVolumeTestJSON-1935244478 None] Deleting attachment c561dae4-bb5f-4bfe-af10-1d87e3eb11a1. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-dde7833d-9c9e-4eec-a897-f4b98c879875-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-dde7833d-9c9e-4eec-a897-f4b98c879875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:03 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Deleted volume successfully. Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Deleting offline snapshot dde7833d-9c9e-4eec-a897-f4b98c879875 of volume 0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] snapshot_file for this snap is: volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f5fce24-0f8a-4d78-a669-64caf8b98a33 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-7468cef9-945a-43b0-9504-8a93b27d7def-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ea395-3a58-42ee-a660-614ff650446c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:03 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:41:03 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d0ffd3e-7017-42f7-a784-1943506ee996 tempest-GroupsTest-229003661 None] Group tempest-Group2-707725161: creating Sep 01 12:41:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d0ffd3e-7017-42f7-a784-1943506ee996 tempest-GroupsTest-229003661 None] Group tempest-Group2-707725161: created successfully Sep 01 12:41:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d0ffd3e-7017-42f7-a784-1943506ee996 tempest-GroupsTest-229003661 None] Create group completed successfully. Sep 01 12:41:03 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f828c4d-f4b1-473b-8cec-aa710509083a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:03 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:41:03 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:04 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.576s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:04 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:41:04 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-e06f6c69-9509-40f4-b25c-81036f145f4e req-3f6bda37-173b-49a0-b782-cf038242e785 tempest-AttachVolumeTestJSON-1935244478 None] Terminate volume connection completed successfully. Sep 01 12:41:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-e06f6c69-9509-40f4-b25c-81036f145f4e req-3f6bda37-173b-49a0-b782-cf038242e785 tempest-AttachVolumeTestJSON-1935244478 None] Deleting attachment 321bf277-4d72-47c9-8900-0c54bc686719. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:41:04 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:04 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875 Sep 01 12:41:04 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:05 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc.dde7833d-9c9e-4eec-a897-f4b98c879875" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-dde7833d-9c9e-4eec-a897-f4b98c879875" released by "_delete_snapshot" :: held 1.800s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" released by "delete_snapshot" :: held 1.829s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['b9f63c4d-0093-442f-9e7f-ef09114704e6', '987e2972-e4f1-40fc-ad28-a5ef57418c5f', '999abe0a-9349-4fd6-87be-cda48feef219', 'e80f15ad-d097-491c-820d-164aaca5033f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Delete snapshot completed successfully. Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-afab5bc2-fc0f-43f7-aeb3-6b0d366fbd2b tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-dde7833d-9c9e-4eec-a897-f4b98c879875-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (ff578de3-5ee6-4222-bae0-8241bcb83a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2f8601-03de-4473-82ab-80690d74a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-0115b9d9-11b9-4602-81d2-e5a15d2331cc-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2f8601-03de-4473-82ab-80690d74a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338535272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d944bddb-9178-42a7-a275-59ec28d1eb71,host='devstack@QuobyteHD#QuobyteHD',id=a57607f3-b12d-4971-ace0-752e7f2799ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:05Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb92649-8083-4fdb-a15e-da8876bc1d14),volume_type_id=2eb92649-8083-4fdb-a15e-da8876bc1d14)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9192d0e0-1cd7-46bc-a868-42aa5893f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9192d0e0-1cd7-46bc-a868-42aa5893f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f596cbf-1eeb-4334-bad1-13471db6a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f596cbf-1eeb-4334-bad1-13471db6a142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57607f3-b12d-4971-ace0-752e7f2799ba', 'volume_name': 'volume-a57607f3-b12d-4971-ace0-752e7f2799ba', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622a5e7a-899e-4039-a5b2-a406da2d70a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622a5e7a-899e-4039-a5b2-a406da2d70a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468624c0-c928-41eb-aed4-ba0c289d56f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:05 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Volume a57607f3-b12d-4971-ace0-752e7f2799ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57607f3-b12d-4971-ace0-752e7f2799ba', 'volume_size': 1} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d944bddb-9178-42a7-a275-59ec28d1eb71,created_at=2026-09-01T10:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338535272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d944bddb-9178-42a7-a275-59ec28d1eb71,host='devstack@QuobyteHD#QuobyteHD',id=a57607f3-b12d-4971-ace0-752e7f2799ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:05Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb92649-8083-4fdb-a15e-da8876bc1d14),volume_type_id=2eb92649-8083-4fdb-a15e-da8876bc1d14)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Creating volume a57607f3-b12d-4971-ace0-752e7f2799ba {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:05 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-0115b9d9-11b9-4602-81d2-e5a15d2331cc-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:05 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba 1073741824 Sep 01 12:41:05 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac099b85-94d7-4a32-90b0-2bda5042afef]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:05 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:41:05 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:06 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba 1073741824" returned: 0 in 0.530s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:06 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba Sep 01 12:41:06 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:06 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.490s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:06 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc Sep 01 12:41:06 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:06 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:06 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0115b9d9-11b9-4602-81d2-e5a15d2331cc" returned: 0 in 0.435s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468624c0-c928-41eb-aed4-ba0c289d56f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57607f3-b12d-4971-ace0-752e7f2799ba', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42030ddd-d69b-43f3-884a-fbc91226e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-0115b9d9-11b9-4602-81d2-e5a15d2331cc" released by "delete_volume" :: held 1.029s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Volume volume-a57607f3-b12d-4971-ace0-752e7f2799ba (a57607f3-b12d-4971-ace0-752e7f2799ba): created successfully Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42030ddd-d69b-43f3-884a-fbc91226e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (ff578de3-5ee6-4222-bae0-8241bcb83a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f3647e01-cc6d-47b7-8f81-fc6f63f0b76f tempest-GroupsTest-229003661 None] Created volume successfully. Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['01df1633-eb05-46d2-93b3-70946fa36128', 'f67088f7-b85f-41d2-b174-11db8f41aef2', 'dca91f12-01ee-46cd-a0ba-013e4965dd40', '8acdd2bf-8789-4abf-b361-8cfabbd463c7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:06 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:06 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:07 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.328s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:07 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Deleted volume successfully. Sep 01 12:41:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-18b9b81d-49af-4d0d-b7c6-96d068c6aa06 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-0115b9d9-11b9-4602-81d2-e5a15d2331cc-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-178aa33e-988c-43e4-a4d4-8acd8b611ba6-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-178aa33e-988c-43e4-a4d4-8acd8b611ba6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[23554098-c1a2-45b6-8a99-b90e0d95dd54]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:08 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 Sep 01 12:41:08 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:08 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6" returned: 0 in 0.487s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:08 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6 Sep 01 12:41:08 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Acquiring lock "cinder-quobyte-a57607f3-b12d-4971-ace0-752e7f2799ba" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-a57607f3-b12d-4971-ace0-752e7f2799ba" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59256a-7b64-4eec-a20c-ced206fb99a0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:09 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-178aa33e-988c-43e4-a4d4-8acd8b611ba6" returned: 0 in 0.556s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-quobyte-178aa33e-988c-43e4-a4d4-8acd8b611ba6" released by "delete_volume" :: held 1.156s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:09 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba Sep 01 12:41:09 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Created reservations ['310adeaa-1f20-4c17-9d02-0aedb4950529', 'd60658b3-d2bf-47a6-b4dd-39dbaadd3bfb', '8a813775-3a69-4e24-87a9-a1bdc0f9bf12', '8873d94a-63c9-4bff-84b8-8c44d6d20d0f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:09 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:09 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:09 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:09 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba Sep 01 12:41:09 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:09 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.305s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Deleted volume successfully. Sep 01 12:41:09 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a57607f3-b12d-4971-ace0-752e7f2799ba" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-a57607f3-b12d-4971-ace0-752e7f2799ba" released by "delete_volume" :: held 0.866s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2204bdad-4612-49f9-8d19-ec9b575f5596 tempest-VolumesSnapshotTestJSON-535104592 None] Lock "cinder-178aa33e-988c-43e4-a4d4-8acd8b611ba6-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:10 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Created reservations ['e89fbc5e-5d3f-44c1-9f23-6fbef8fbebe8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:10 devstack cinder-volume[87008]: WARNING cinder.quota [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1201675331 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1201675331, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:41:10 devstack cinder-volume[87008]: WARNING cinder.quota [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1201675331 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1201675331, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:41:10 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Created reservations ['eb8bccd8-dde7-4594-bb1c-8fc7c6c810b8', 'aa716a1c-e026-4ba1-986b-e2c0c77f37d7', '76e50b36-4d07-43ff-b628-1d41e056acbe', '8f61d614-12c4-43a6-89de-3a7df2750ef6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-1cc8e3d5-1b66-49e5-8137-24fec6106950-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-1cc8e3d5-1b66-49e5-8137-24fec6106950-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-quobyte-1cc8e3d5-1b66-49e5-8137-24fec6106950" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-1cc8e3d5-1b66-49e5-8137-24fec6106950" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[95193077-e5bb-402c-b51e-666bf25e809e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:11 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 Sep 01 12:41:11 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:11 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950" returned: 0 in 0.394s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:11 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950 Sep 01 12:41:11 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:12 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1cc8e3d5-1b66-49e5-8137-24fec6106950" returned: 0 in 0.292s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-1cc8e3d5-1b66-49e5-8137-24fec6106950" released by "delete_volume" :: held 0.741s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Created reservations ['c12dd45d-9b41-44f5-8b4b-34049eaa293f', '1b2a38a0-4969-4903-8400-e925d88e4806', '1c94e848-cf35-4d58-8985-eccabb8faf23', 'f872ff72-d61a-46e7-847b-d091c6dc5f78'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:12 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:12 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:12 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.450s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:12 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5bc009c7-8af8-4017-80d0-5ecd6a4731ab tempest-GroupsTest-229003661 None] Delete group completed successfully. Sep 01 12:41:12 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:12 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:13 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.384s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Deleted volume successfully. Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ed141d1-de5a-4a34-956e-9d0c55084aef tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-1cc8e3d5-1b66-49e5-8137-24fec6106950-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Created reservations ['35288a4e-0e75-4600-b37f-985c25738e81'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-9f05abf9-53d5-4da6-954b-97611ee6eb55-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-9f05abf9-53d5-4da6-954b-97611ee6eb55-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:14 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:14 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-quobyte-9f05abf9-53d5-4da6-954b-97611ee6eb55" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-9f05abf9-53d5-4da6-954b-97611ee6eb55" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e79149-120b-48c3-9935-9363094a86c6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:14 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 Sep 01 12:41:14 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:14 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c8059743-1b25-4062-93a0-2835e67cab9f tempest-GroupsTest-229003661 None] Delete group completed successfully. Sep 01 12:41:14 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55" returned: 0 in 0.445s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:14 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55 Sep 01 12:41:14 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:14 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9f05abf9-53d5-4da6-954b-97611ee6eb55" returned: 0 in 0.249s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-9f05abf9-53d5-4da6-954b-97611ee6eb55" released by "delete_volume" :: held 0.740s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Created reservations ['9ef9b1ad-d1f1-42b6-bc97-91d274e25cf2', '48a8a3c7-c1ce-46da-922d-096139fe1cb7', 'f5497731-f4ac-45a2-983c-d1b0eab9c60e', 'f5595016-248e-46d1-81e2-f42b99daaecb'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-b2147de7-d6bd-42e7-8856-61b982da5afd tempest-ServerActionsTestOtherA-1430068175 None] Terminate volume connection completed successfully. Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-b2147de7-d6bd-42e7-8856-61b982da5afd tempest-ServerActionsTestOtherA-1430068175 None] Deleting attachment d2facd91-4f92-4746-843e-2b023ece2ea4. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:15 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:15 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "cinder-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "cinder-quobyte-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-quobyte-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9691cbde-0886-431d-86a6-871b2b7aaef6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-f5afe53c-e564-4b5d-b3ba-9155d785cd20-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea542dbd-1758-4ccb-a480-fe20a28cb5b4 tempest-GroupsTest-229003661 None] Group tempest-GroupsTest-Group-1631738519: creating Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-f5afe53c-e564-4b5d-b3ba-9155d785cd20-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea542dbd-1758-4ccb-a480-fe20a28cb5b4 tempest-GroupsTest-229003661 None] Group tempest-GroupsTest-Group-1631738519: created successfully Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "cinder-quobyte-f5afe53c-e564-4b5d-b3ba-9155d785cd20" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ea542dbd-1758-4ccb-a480-fe20a28cb5b4 tempest-GroupsTest-229003661 None] Create group completed successfully. Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-f5afe53c-e564-4b5d-b3ba-9155d785cd20" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:16 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.716s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Deleted volume successfully. Sep 01 12:41:16 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 Sep 01 12:41:16 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7bc42-a820-4c28-b79d-84af1029975a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f671a073-a59b-4464-af92-e340187f9072 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-9f05abf9-53d5-4da6-954b-97611ee6eb55-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:16 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 Sep 01 12:41:16 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:16 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" returned: 0 in 0.584s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:17 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7 Sep 01 12:41:17 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:17 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20" returned: 0 in 0.504s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:17 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20 Sep 01 12:41:17 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:17 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" returned: 0 in 0.294s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-quobyte-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7" released by "delete_volume" :: held 1.012s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.quota [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Created reservations ['d96f7ce0-3070-4efe-911b-41ab53e46091', 'ad3bc155-d0de-4031-bb10-6052cca9d81f', '1162af77-be9c-4483-a905-6cdb9db609cb', '00196e31-6e09-4727-81ef-c186639a0870'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:17 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5afe53c-e564-4b5d-b3ba-9155d785cd20" returned: 0 in 0.308s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:17 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:17 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-quobyte-f5afe53c-e564-4b5d-b3ba-9155d785cd20" released by "delete_volume" :: held 0.879s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Created reservations ['af856e43-091c-47de-9017-fead0e8cdfda', 'a85d0f34-0718-44a2-82b3-f3fbe83c8d89', '2c40775e-31ea-495d-83a3-ffe646bf8b63', '241625eb-10cf-4f09-8a57-27cdfa2defd9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:17 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.407s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.manager [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "cinder-5d07a838-56d8-46bd-8f15-7b5a92147647-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:17 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:17 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Deleted volume successfully. Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-5d07a838-56d8-46bd-8f15-7b5a92147647-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-9bca1a7c-8c70-417b-ac59-6161d2100af3 req-28d6414c-92bd-49f9-9bb4-e1f94c88462a tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-08bf9d4e-1f8a-42ce-9a29-9f3198f581e7-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "cinder-quobyte-5d07a838-56d8-46bd-8f15-7b5a92147647" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-quobyte-5d07a838-56d8-46bd-8f15-7b5a92147647" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e861b1-7eef-40bb-b37d-15dfb631e876]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:18 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.403s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Deleted volume successfully. Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e369ebc9-c364-4ec0-a812-f7fa2511fcd8 tempest-AttachVolumeTestJSON-1935244478 None] Lock "cinder-f5afe53c-e564-4b5d-b3ba-9155d785cd20-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:18 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 Sep 01 12:41:18 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (a42de33a-b3f7-4745-a059-98a51ea5f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9e317d-9e05-4094-8749-af46f57c9c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9e317d-9e05-4094-8749-af46f57c9c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750467590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,host='devstack@QuobyteHD#QuobyteHD',id=424dc562-c3b1-4b72-86a3-27cd5713d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:18Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168156d5-bafa-4a5a-9da5-4ad2708cf038),volume_type_id=168156d5-bafa-4a5a-9da5-4ad2708cf038)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345a8af-448f-4828-b3cd-111094d2f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345a8af-448f-4828-b3cd-111094d2f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff2cdc4-3940-4dd6-af17-38d99ba16a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff2cdc4-3940-4dd6-af17-38d99ba16a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424dc562-c3b1-4b72-86a3-27cd5713d5ef', 'volume_name': 'volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bcc4ed-9eb9-4ee4-b9c4-0b432393f233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bcc4ed-9eb9-4ee4-b9c4-0b432393f233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd77ee-7e25-41f6-80e8-87657524b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Volume 424dc562-c3b1-4b72-86a3-27cd5713d5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef', 'volume_size': 1} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,created_at=2026-09-01T10:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750467590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,host='devstack@QuobyteHD#QuobyteHD',id=424dc562-c3b1-4b72-86a3-27cd5713d5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:18Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168156d5-bafa-4a5a-9da5-4ad2708cf038),volume_type_id=168156d5-bafa-4a5a-9da5-4ad2708cf038)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Creating volume 424dc562-c3b1-4b72-86a3-27cd5713d5ef {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:18 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:18 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647" returned: 0 in 0.500s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:18 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef 1073741824 Sep 01 12:41:18 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:18 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647 Sep 01 12:41:18 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:18 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5d07a838-56d8-46bd-8f15-7b5a92147647" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-quobyte-5d07a838-56d8-46bd-8f15-7b5a92147647" released by "delete_volume" :: held 0.875s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:18 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Created reservations ['fda4b3b1-a647-4dd5-8f82-78b0286362e4', 'f665f172-8871-40f8-9edf-1d94958de045', 'b26e2d73-593e-4c86-9d65-f573cf211dde', '3200f73f-770c-4d2b-ba28-933a61e7c139'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:19 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:19 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:19 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef 1073741824" returned: 0 in 0.666s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:19 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef Sep 01 12:41:19 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:19 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.507s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Deleted volume successfully. Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-75f66832-f799-4b3c-ae6d-e83b34f60662 tempest-ServerActionsTestOtherA-1430068175 None] Lock "cinder-5d07a838-56d8-46bd-8f15-7b5a92147647-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:19 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef" returned: 0 in 0.447s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd77ee-7e25-41f6-80e8-87657524b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d8b75a-84ef-4531-bf56-47cb6774098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:19 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Volume volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef (424dc562-c3b1-4b72-86a3-27cd5713d5ef): created successfully Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d8b75a-84ef-4531-bf56-47cb6774098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (a42de33a-b3f7-4745-a059-98a51ea5f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0acde72d-256b-455c-957f-eb79b4011569 tempest-GroupsTest-229003661 None] Created volume successfully. Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (796b936b-6dc2-4e13-9d76-7b0b206b96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105e5044-3b0a-4ae9-a151-74fe6c46e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105e5044-3b0a-4ae9-a151-74fe6c46e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109814151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,host='devstack@QuobyteHD#QuobyteHD',id=8367f700-db05-4640-ab9e-9d8d82560761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:22Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168156d5-bafa-4a5a-9da5-4ad2708cf038),volume_type_id=168156d5-bafa-4a5a-9da5-4ad2708cf038)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536afd05-f298-45d6-8992-b10710de8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536afd05-f298-45d6-8992-b10710de8732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d40214-93cc-4a3c-aa16-d9f5a090514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d40214-93cc-4a3c-aa16-d9f5a090514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8367f700-db05-4640-ab9e-9d8d82560761', 'volume_name': 'volume-8367f700-db05-4640-ab9e-9d8d82560761', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cf13d2-f314-41ba-86e1-e0a8d8356031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cf13d2-f314-41ba-86e1-e0a8d8356031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352861a5-3b91-405d-ba4c-e2c5e18173d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Volume 8367f700-db05-4640-ab9e-9d8d82560761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8367f700-db05-4640-ab9e-9d8d82560761', 'volume_size': 1} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,created_at=2026-09-01T10:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2109814151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0eee41e-ef9a-4660-ad38-93620b4bfc66,host='devstack@QuobyteHD#QuobyteHD',id=8367f700-db05-4640-ab9e-9d8d82560761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0852ecc475a9409994409866641a56d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:22Z,use_quota=True,user_id='8b9c856679b643ecad47ef4eea3860a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168156d5-bafa-4a5a-9da5-4ad2708cf038),volume_type_id=168156d5-bafa-4a5a-9da5-4ad2708cf038)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Creating volume 8367f700-db05-4640-ab9e-9d8d82560761 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:21 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:21 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 1073741824 Sep 01 12:41:21 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:22 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 1073741824" returned: 0 in 0.525s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:22 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 Sep 01 12:41:22 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:22 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352861a5-3b91-405d-ba4c-e2c5e18173d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8367f700-db05-4640-ab9e-9d8d82560761', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1278cd-540b-47c2-946d-39bb278c7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Volume volume-8367f700-db05-4640-ab9e-9d8d82560761 (8367f700-db05-4640-ab9e-9d8d82560761): created successfully Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1278cd-540b-47c2-946d-39bb278c7040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Flow 'volume_create_manager' (796b936b-6dc2-4e13-9d76-7b0b206b96a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b928a10d-9a7f-4029-8870-110b70c209c2 tempest-GroupsTest-229003661 None] Created volume successfully. Sep 01 12:41:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9c519657-4705-49e1-9213-63d84f3a9286 tempest-GroupsTest-229003661 None] Update group completed successfully. Sep 01 12:41:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b25ecded-113f-4029-9af2-7e765e0cc405 tempest-GroupsTest-229003661 None] Update group completed successfully. Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:26 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:26 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:26 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:41:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:41:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Acquiring lock "cinder-quobyte-424dc562-c3b1-4b72-86a3-27cd5713d5ef" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-424dc562-c3b1-4b72-86a3-27cd5713d5ef" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c360d6-ff1b-4c92-9ed1-a7d47acc3c36]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:27 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef Sep 01 12:41:27 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:28 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:28 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef Sep 01 12:41:28 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:28 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-424dc562-c3b1-4b72-86a3-27cd5713d5ef" returned: 0 in 0.284s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-424dc562-c3b1-4b72-86a3-27cd5713d5ef" released by "delete_volume" :: held 0.793s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Acquiring lock "cinder-quobyte-8367f700-db05-4640-ab9e-9d8d82560761" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-8367f700-db05-4640-ab9e-9d8d82560761" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eae6b4-eb48-4430-a77e-6b5abe952696]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:28 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 Sep 01 12:41:28 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:29 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761" returned: 0 in 0.513s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:29 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761 Sep 01 12:41:29 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:29 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8367f700-db05-4640-ab9e-9d8d82560761" returned: 0 in 0.398s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "cinder-quobyte-8367f700-db05-4640-ab9e-9d8d82560761" released by "delete_volume" :: held 0.974s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Created reservations ['ae8cfce2-db92-46ba-906f-ba0292b1e3e2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:29 devstack cinder-volume[87008]: WARNING cinder.quota [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1761351232 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1761351232, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:41:29 devstack cinder-volume[87008]: WARNING cinder.quota [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1761351232 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1761351232, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Created reservations ['2ff222ed-358b-4b9d-ac05-4a061362ef72', '402a6ff8-56c0-462a-80c9-51268869b14d', '15cec65d-2908-4903-90c7-df7b0e16b684', '6bd14fba-7d09-484b-a2a3-b2b28555debc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:29 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Created reservations ['e6ae815a-3fd4-41a0-9533-147ece7f11b0', '15148002-eaff-4461-aa9d-e184209d6ebb', 'bcedd7ac-4f12-47e4-9ade-03ea176ef387', 'b60165f8-f192-47e8-9744-3472b7a04884'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:30 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:30 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:30 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.593s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:30 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fa0b1ad6-922d-49fb-ab87-ddbdecbb92d2 tempest-GroupsTest-229003661 None] Delete group completed successfully. Sep 01 12:41:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9d0b1d5c-463e-40fc-8417-8e82c74f5b83 tempest-BackendsCapabilitiesAdminTestsJSON-568130998 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9766807556152, 'free_capacity_gb': 1773.9766807556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87008) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:41:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-00f9aeee-de39-4a09-8be6-6361d1586b8e tempest-BackendsCapabilitiesAdminTestsJSON-568130998 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9766807556152, 'free_capacity_gb': 1773.9766807556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87008) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:41:39 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:INSERT=47,cinder:UPDATE=197,cinder:SELECT=169,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:41:39 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=183,cinder:UPDATE=199,cinder:INSERT=45,cinder:DELETE=13 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Flow 'volume_create_manager' (cad73a5f-b1cf-4f47-b3a7-e2c5298c5128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8289141f-ad8b-4987-8e33-c81b195d7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8289141f-ad8b-4987-8e33-c81b195d7d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-477066457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d18e529-858d-46db-aa66-f178805d7220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a04dc223474500b1c6e9404cf737d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:41Z,use_quota=True,user_id='11332077bc2b48979b6058460fc7db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eb4e95-cad5-44ff-881b-4272bc57f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eb4e95-cad5-44ff-881b-4272bc57f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c5cf16-e407-484e-8e7d-d79f3848f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c5cf16-e407-484e-8e7d-d79f3848f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d18e529-858d-46db-aa66-f178805d7220', 'volume_name': 'volume-8d18e529-858d-46db-aa66-f178805d7220', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4770abd-77c1-43d7-9450-03706bc6225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4770abd-77c1-43d7-9450-03706bc6225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07bbab3-73a6-4390-9200-2ce7017557c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:41 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume 8d18e529-858d-46db-aa66-f178805d7220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d18e529-858d-46db-aa66-f178805d7220', 'volume_size': 1} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-477066457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d18e529-858d-46db-aa66-f178805d7220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a04dc223474500b1c6e9404cf737d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:41Z,use_quota=True,user_id='11332077bc2b48979b6058460fc7db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Creating volume 8d18e529-858d-46db-aa66-f178805d7220 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:41 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:41 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 1073741824 Sep 01 12:41:41 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:42 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 1073741824" returned: 0 in 0.572s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:42 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 Sep 01 12:41:42 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:42 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220" returned: 0 in 0.335s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07bbab3-73a6-4390-9200-2ce7017557c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d18e529-858d-46db-aa66-f178805d7220', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4f8273-1aa2-4924-8f3b-91d097070d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:42 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume volume-8d18e529-858d-46db-aa66-f178805d7220 (8d18e529-858d-46db-aa66-f178805d7220): created successfully Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4f8273-1aa2-4924-8f3b-91d097070d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Flow 'volume_create_manager' (cad73a5f-b1cf-4f47-b3a7-e2c5298c5128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c2c1e123-7bb9-4bc5-9d27-4c99072034e6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Created volume successfully. Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "cinder-8d18e529-858d-46db-aa66-f178805d7220-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "cinder-8d18e529-858d-46db-aa66-f178805d7220-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "cinder-quobyte-8d18e529-858d-46db-aa66-f178805d7220" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "cinder-quobyte-8d18e529-858d-46db-aa66-f178805d7220" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a3636-d868-4f87-bc59-2533940506c3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:43 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 Sep 01 12:41:43 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:44 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220" returned: 0 in 0.471s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:44 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220 Sep 01 12:41:44 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:44 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8d18e529-858d-46db-aa66-f178805d7220" returned: 0 in 0.355s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "cinder-quobyte-8d18e529-858d-46db-aa66-f178805d7220" released by "delete_volume" :: held 0.878s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Created reservations ['85a56890-bada-4c8d-9987-13656c1d2fef', '5fa1dfb6-ff48-4208-93dc-a78d7a00203e', '9dea192f-0a13-433f-964c-22219c83ad09', '1c7e59de-294c-4110-9b51-5dd94975ea15'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:44 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:44 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:45 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.334s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:45 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Deleted volume successfully. Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-185f64d6-1f6b-4979-9b94-3db302cfd1d6 tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "cinder-8d18e529-858d-46db-aa66-f178805d7220-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Flow 'volume_create_manager' (56a2645f-9c3c-4b32-8e73-9a84eadf212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12047095-f304-4618-98b3-2e6ab1883745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12047095-f304-4618-98b3-2e6ab1883745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-571578918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17228efa-8a4f-4249-8ed5-67c19fa28f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a04dc223474500b1c6e9404cf737d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:46Z,use_quota=True,user_id='11332077bc2b48979b6058460fc7db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8fa65-5681-4b8c-b337-f3754e4d1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d8fa65-5681-4b8c-b337-f3754e4d1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa6b09-9a7a-4460-ab29-013433d7093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa6b09-9a7a-4460-ab29-013433d7093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17228efa-8a4f-4249-8ed5-67c19fa28f92', 'volume_name': 'volume-17228efa-8a4f-4249-8ed5-67c19fa28f92', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da958a3-69dd-43fd-885f-bb71a5c1226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da958a3-69dd-43fd-885f-bb71a5c1226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8acf0c-bd54-49a8-9097-df39003301b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:45 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume 17228efa-8a4f-4249-8ed5-67c19fa28f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17228efa-8a4f-4249-8ed5-67c19fa28f92', 'volume_size': 1} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-571578918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17228efa-8a4f-4249-8ed5-67c19fa28f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a04dc223474500b1c6e9404cf737d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:46Z,use_quota=True,user_id='11332077bc2b48979b6058460fc7db0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Creating volume 17228efa-8a4f-4249-8ed5-67c19fa28f92 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:45 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:45 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 1073741824 Sep 01 12:41:45 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:46 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 1073741824" returned: 0 in 0.535s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:46 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 Sep 01 12:41:46 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:46 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8acf0c-bd54-49a8-9097-df39003301b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17228efa-8a4f-4249-8ed5-67c19fa28f92', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0605b866-99fe-4047-b303-31488bf6e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:46 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Volume volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 (17228efa-8a4f-4249-8ed5-67c19fa28f92): created successfully Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0605b866-99fe-4047-b303-31488bf6e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Flow 'volume_create_manager' (56a2645f-9c3c-4b32-8e73-9a84eadf212d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-90ee6f6c-79ae-42c5-a188-86b8f5c13c1e tempest-VolumeQuotasAdminTestJSON-1010834400 None] Created volume successfully. Sep 01 12:41:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-28ddeb4b-569a-4e09-b8e5-37b539928101 tempest-VolumeQuotasAdminTestJSON-1226216249 None] Transfer volume completed successfully. Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Acquiring lock "cinder-17228efa-8a4f-4249-8ed5-67c19fa28f92-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "cinder-17228efa-8a4f-4249-8ed5-67c19fa28f92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Acquiring lock "cinder-quobyte-17228efa-8a4f-4249-8ed5-67c19fa28f92" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "cinder-quobyte-17228efa-8a4f-4249-8ed5-67c19fa28f92" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c41f97-2799-4e36-bb9f-11266b645fce]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:49 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 Sep 01 12:41:49 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:49 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92" returned: 0 in 0.452s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:49 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92 Sep 01 12:41:49 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:50 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17228efa-8a4f-4249-8ed5-67c19fa28f92" returned: 0 in 0.325s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "cinder-quobyte-17228efa-8a4f-4249-8ed5-67c19fa28f92" released by "delete_volume" :: held 0.842s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Created reservations ['e5931d20-bef2-4eb5-8b88-33d643e353c5', '636d17e0-ef84-4a31-a5bd-3d5c9a056652', 'fde4bcbe-6de3-4769-b82c-af6f40e0fcde', '6a1fa9f8-3730-487a-b26a-44dab86886b1'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:50 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:41:50 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:50 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.292s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:41:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Deleted volume successfully. Sep 01 12:41:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6db2f460-09f8-4f89-a35e-45c893e1ee42 tempest-VolumeQuotasAdminTestJSON-453723653 None] Lock "cinder-17228efa-8a4f-4249-8ed5-67c19fa28f92-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Flow 'volume_create_manager' (aa4c8d6a-d817-4ce8-9835-a3bfca184df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de4db15-8501-4681-8f0e-46313e5e9d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de4db15-8501-4681-8f0e-46313e5e9d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-940744279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18e097-fae2-4991-b996-cee7020c84fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebc53111914552b5f7e64f6d261434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:52Z,use_quota=True,user_id='87ba0b79e06b41b3a94e93b30b828b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a1ee74-b01d-4afa-9852-7c7a8368bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a1ee74-b01d-4afa-9852-7c7a8368bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23be736-1467-43a7-8603-4b668d12ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23be736-1467-43a7-8603-4b668d12ee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff18e097-fae2-4991-b996-cee7020c84fd', 'volume_name': 'volume-ff18e097-fae2-4991-b996-cee7020c84fd', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6911e461-bad3-4074-a33a-8ca5d3b06ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6911e461-bad3-4074-a33a-8ca5d3b06ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1eda9fd-af70-46e5-9e4f-3500d62a21ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume ff18e097-fae2-4991-b996-cee7020c84fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff18e097-fae2-4991-b996-cee7020c84fd', 'volume_size': 1} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-940744279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff18e097-fae2-4991-b996-cee7020c84fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebc53111914552b5f7e64f6d261434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:52Z,use_quota=True,user_id='87ba0b79e06b41b3a94e93b30b828b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Creating volume ff18e097-fae2-4991-b996-cee7020c84fd {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:52 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:52 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd 1073741824 Sep 01 12:41:52 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Flow 'volume_create_manager' (8765ff60-b037-4c04-8876-b5140ec06c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeec486-b8c8-4483-9ea9-6a8bb0fc1e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeec486-b8c8-4483-9ea9-6a8bb0fc1e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-471826712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230e709b-4184-4298-b45f-cbe6c5c20cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebc53111914552b5f7e64f6d261434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:53Z,use_quota=True,user_id='87ba0b79e06b41b3a94e93b30b828b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038a9e65-189e-48ed-9b79-db29c1b1ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038a9e65-189e-48ed-9b79-db29c1b1ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6de4f4-b7cb-4150-9d07-b63c6acfcc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6de4f4-b7cb-4150-9d07-b63c6acfcc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230e709b-4184-4298-b45f-cbe6c5c20cfb', 'volume_name': 'volume-230e709b-4184-4298-b45f-cbe6c5c20cfb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a5032c-d193-478d-a6e3-c05aaa58b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a5032c-d193-478d-a6e3-c05aaa58b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8ebd5-ffdc-4877-a85b-ca6a9ea33119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume 230e709b-4184-4298-b45f-cbe6c5c20cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230e709b-4184-4298-b45f-cbe6c5c20cfb', 'volume_size': 1} Sep 01 12:41:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:53 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd 1073741824" returned: 0 in 0.874s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:53 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd Sep 01 12:41:53 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:53 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd" returned: 0 in 0.344s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-471826712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230e709b-4184-4298-b45f-cbe6c5c20cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebc53111914552b5f7e64f6d261434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:41:53Z,use_quota=True,user_id='87ba0b79e06b41b3a94e93b30b828b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Creating volume 230e709b-4184-4298-b45f-cbe6c5c20cfb {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:41:53 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1eda9fd-af70-46e5-9e4f-3500d62a21ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff18e097-fae2-4991-b996-cee7020c84fd', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:53 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb 1073741824 Sep 01 12:41:53 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c655b9cb-2002-48b0-b963-0d3ae2987caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume volume-ff18e097-fae2-4991-b996-cee7020c84fd (ff18e097-fae2-4991-b996-cee7020c84fd): created successfully Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c655b9cb-2002-48b0-b963-0d3ae2987caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Flow 'volume_create_manager' (aa4c8d6a-d817-4ce8-9835-a3bfca184df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0286b7f2-5cf6-47c1-ad0f-97f4c40ab161 tempest-TestServerVolumeAttachmentScenario-680651441 None] Created volume successfully. Sep 01 12:41:54 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb 1073741824" returned: 0 in 0.614s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:41:54 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb Sep 01 12:41:54 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:41:54 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb" returned: 0 in 0.351s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c8ebd5-ffdc-4877-a85b-ca6a9ea33119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230e709b-4184-4298-b45f-cbe6c5c20cfb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c0dc8d-c9bb-4939-8f17-a60636ba67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:41:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Volume volume-230e709b-4184-4298-b45f-cbe6c5c20cfb (230e709b-4184-4298-b45f-cbe6c5c20cfb): created successfully Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c0dc8d-c9bb-4939-8f17-a60636ba67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:41:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Flow 'volume_create_manager' (8765ff60-b037-4c04-8876-b5140ec06c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:41:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-80a664d6-7cfa-4505-8179-57cff63c9902 tempest-TestServerVolumeAttachmentScenario-680651441 None] Created volume successfully. Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Flow 'volume_create_manager' (bdd122f5-ad21-45a3-a7a5-e206e8598faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed1beef-4e63-47ce-a457-edb427d96762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed1beef-4e63-47ce-a457-edb427d96762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-87486897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fa7c0d-25f8-4240-85db-87e3d4fa63da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074d1ce245a942b1af1d0e16d8f0f1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:02Z,use_quota=True,user_id='244e05157b404fbd82a5d94ca59440b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd8cf0ab-5e37-4b82-8d08-fa1e5814adf1),volume_type_id=fd8cf0ab-5e37-4b82-8d08-fa1e5814adf1)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372c456-9126-4d9f-b943-65181503d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372c456-9126-4d9f-b943-65181503d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2c74f6-d1a6-464b-aa40-796ba57b0c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2c74f6-d1a6-464b-aa40-796ba57b0c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5fa7c0d-25f8-4240-85db-87e3d4fa63da', 'volume_name': 'volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2375ce2b-0e91-4cdb-ac60-c23afc5c1b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2375ce2b-0e91-4cdb-ac60-c23afc5c1b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94dfea94-8d42-45bb-80f6-df30a4fda4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:02 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Volume f5fa7c0d-25f8-4240-85db-87e3d4fa63da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da', 'volume_size': 1} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-87486897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fa7c0d-25f8-4240-85db-87e3d4fa63da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074d1ce245a942b1af1d0e16d8f0f1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:02Z,use_quota=True,user_id='244e05157b404fbd82a5d94ca59440b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd8cf0ab-5e37-4b82-8d08-fa1e5814adf1),volume_type_id=fd8cf0ab-5e37-4b82-8d08-fa1e5814adf1)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Creating volume f5fa7c0d-25f8-4240-85db-87e3d4fa63da {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:02 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:02 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da 1073741824 Sep 01 12:42:02 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:02 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da 1073741824" returned: 0 in 0.555s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:03 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da Sep 01 12:42:03 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:03 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" returned: 0 in 0.561s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94dfea94-8d42-45bb-80f6-df30a4fda4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4293cb58-679e-491f-b8c1-83fd90f7d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:03 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Volume volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da (f5fa7c0d-25f8-4240-85db-87e3d4fa63da): created successfully Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4293cb58-679e-491f-b8c1-83fd90f7d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Flow 'volume_create_manager' (bdd122f5-ad21-45a3-a7a5-e206e8598faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3c4592ac-5e83-4a4e-9e11-8972e76de12c tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Created volume successfully. Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:05 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:05 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:05 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.494s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:05 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-525c7692-6913-4299-884d-3ced4472f4c9 tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Retype volume completed successfully. Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "cinder-f5fa7c0d-25f8-4240-85db-87e3d4fa63da-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "cinder-f5fa7c0d-25f8-4240-85db-87e3d4fa63da-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "cinder-quobyte-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "cinder-quobyte-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" acquired by "delete_volume" :: waited 0.043s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e044d-26e8-4f20-8b36-6bc33e311f3f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:07 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da Sep 01 12:42:07 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:08 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" returned: 0 in 1.137s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:08 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da Sep 01 12:42:08 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:09 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" returned: 0 in 0.608s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "cinder-quobyte-f5fa7c0d-25f8-4240-85db-87e3d4fa63da" released by "delete_volume" :: held 1.852s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:09 devstack cinder-volume[87008]: WARNING cinder.quota [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:42:09 devstack cinder-volume[87008]: WARNING cinder.quota [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Created reservations ['390d9b9f-cca8-42cf-993b-806ea5d99d87', 'fb5fc7ad-2221-4d26-9b5d-b0ed5fb05d52', 'de41dd51-ff60-4b38-b48f-ce20b0127848', '44a6d566-cd3c-471a-a1bc-1372859e454a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Flow 'volume_create_manager' (23dacec7-c3df-495d-90dc-89040ee706bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7afa2d-a121-4943-a136-b28e145a6c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7afa2d-a121-4943-a136-b28e145a6c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1300121313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4a65e5-4171-4828-b6bd-d9106b989158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6a93cd60743cea28a6efcf4121fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:10Z,use_quota=True,user_id='f3db6e95e9514bd6b7e574bde2d8b4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856cd685-38f1-475d-8e74-7be36b3a50e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856cd685-38f1-475d-8e74-7be36b3a50e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4496ef75-d58a-47ed-8458-d85e4f2afed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4496ef75-d58a-47ed-8458-d85e4f2afed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4a65e5-4171-4828-b6bd-d9106b989158', 'volume_name': 'volume-8b4a65e5-4171-4828-b6bd-d9106b989158', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1cf0bb-e5de-471d-828f-3a4b1d03f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1cf0bb-e5de-471d-828f-3a4b1d03f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b62c42-e1a2-4fc5-8456-506a9df27049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Volume 8b4a65e5-4171-4828-b6bd-d9106b989158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4a65e5-4171-4828-b6bd-d9106b989158', 'volume_size': 1} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1300121313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4a65e5-4171-4828-b6bd-d9106b989158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6a93cd60743cea28a6efcf4121fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:10Z,use_quota=True,user_id='f3db6e95e9514bd6b7e574bde2d8b4cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Creating volume 8b4a65e5-4171-4828-b6bd-d9106b989158 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:09 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:09 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 1073741824 Sep 01 12:42:09 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:10 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:10 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:10 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.740s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Deleted volume successfully. Sep 01 12:42:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f042f9b9-0441-4e5d-852d-3fbb4287925d tempest-VolumeRetypeWithoutMigrationTest-419055346 None] Lock "cinder-f5fa7c0d-25f8-4240-85db-87e3d4fa63da-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:11 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 1073741824" returned: 0 in 1.169s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:11 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 Sep 01 12:42:11 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:11 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158" returned: 0 in 0.405s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b62c42-e1a2-4fc5-8456-506a9df27049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4a65e5-4171-4828-b6bd-d9106b989158', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2899a6-12fa-4d04-8a04-5d273b329621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Volume volume-8b4a65e5-4171-4828-b6bd-d9106b989158 (8b4a65e5-4171-4828-b6bd-d9106b989158): created successfully Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2899a6-12fa-4d04-8a04-5d273b329621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Flow 'volume_create_manager' (23dacec7-c3df-495d-90dc-89040ee706bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f739d0a-71eb-4a80-9a28-43ce88a4c135 tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Created volume successfully. Sep 01 12:42:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Acquiring lock "cinder-8b4a65e5-4171-4828-b6bd-d9106b989158-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "cinder-8b4a65e5-4171-4828-b6bd-d9106b989158-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Acquiring lock "cinder-quobyte-8b4a65e5-4171-4828-b6bd-d9106b989158" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "cinder-quobyte-8b4a65e5-4171-4828-b6bd-d9106b989158" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c47519-53ec-41db-8ee2-962775ca0580]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:15 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 Sep 01 12:42:15 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:15 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158" returned: 0 in 0.546s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:15 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158 Sep 01 12:42:15 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:15 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8b4a65e5-4171-4828-b6bd-d9106b989158" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "cinder-quobyte-8b4a65e5-4171-4828-b6bd-d9106b989158" released by "delete_volume" :: held 0.908s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Created reservations ['a2d1834c-5939-47c5-8192-b95172f788dc', '9d9ee2dc-2236-4a9e-9797-5f025438f24a', '2588041e-3499-4107-b252-8f4271aa802e', '4436d50d-bfd6-4f6d-a6be-3a0ad810c27f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:16 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:16 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:16 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Deleted volume successfully. Sep 01 12:42:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dd719b00-3fad-42ba-9934-9199d793861f tempest-VolumeQuotasNegativeTestJSON-1051912244 None] Lock "cinder-8b4a65e5-4171-4828-b6bd-d9106b989158-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=44,cinder:UPDATE=55,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=55,cinder:SELECT=36,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:26 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:26 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:26 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:42:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (f6cd6517-83cc-46d9-bc3c-5357f03c4cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af03543-d503-4e8f-9f95-a93a32cc513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af03543-d503-4e8f-9f95-a93a32cc513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-529420697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5ce39f-b923-48b3-a908-a465e1a34cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca348c4678b142f1a3e05eaf7c15c734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:28Z,use_quota=True,user_id='40bed3b98bb94a83ac0e520c60fdac7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259ce82f-320e-4146-8426-221aa098ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259ce82f-320e-4146-8426-221aa098ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe9fc1-ecb8-4af7-bacf-c7a34dbcb4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe9fc1-ecb8-4af7-bacf-c7a34dbcb4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5ce39f-b923-48b3-a908-a465e1a34cd3', 'volume_name': 'volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49126401-9f13-4ddd-9b42-25282cabf424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49126401-9f13-4ddd-9b42-25282cabf424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38213594-586a-4ec1-8454-192b0ef4e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:28 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3', 'volume_size': 1} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-529420697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5ce39f-b923-48b3-a908-a465e1a34cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca348c4678b142f1a3e05eaf7c15c734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:28Z,use_quota=True,user_id='40bed3b98bb94a83ac0e520c60fdac7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Creating volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:28 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:28 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 1073741824 Sep 01 12:42:28 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:28 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 1073741824" returned: 0 in 0.471s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:28 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:28 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:29 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.310s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38213594-586a-4ec1-8454-192b0ef4e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972d0cd-69af-42ca-9f2c-38e91d6a8e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Volume volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 (3f5ce39f-b923-48b3-a908-a465e1a34cd3): created successfully Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972d0cd-69af-42ca-9f2c-38e91d6a8e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (f6cd6517-83cc-46d9-bc3c-5357f03c4cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-83e1ecfc-4b4a-4a63-8ffc-333d204d3de0 tempest-VolumesDeleteCascade-1320162602 None] Created volume successfully. Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Flow 'volume_create_manager' (44df526a-cb2e-4520-b8cb-15ad6be50d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711d9e8-9ed7-41a5-8c09-e7ca300df80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711d9e8-9ed7-41a5-8c09-e7ca300df80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-536711916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d5338-13dd-4a95-b262-ef981d8fab00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b207699d20a441ba1d912eb76a6f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:29Z,use_quota=True,user_id='cd5a4466efd2491581b8c2c2d0220962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2237b0d1-ace3-46d6-ba9d-11eb0fbab141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2237b0d1-ace3-46d6-ba9d-11eb0fbab141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87165ab6-6eb0-479e-b36a-d6c885cfc35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87165ab6-6eb0-479e-b36a-d6c885cfc35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6d5338-13dd-4a95-b262-ef981d8fab00', 'volume_name': 'volume-0e6d5338-13dd-4a95-b262-ef981d8fab00', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23d042b-912e-40d5-9d09-93fd8256914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23d042b-912e-40d5-9d09-93fd8256914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8c6b43-1c26-4a88-8582-b839b9611af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Volume 0e6d5338-13dd-4a95-b262-ef981d8fab00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6d5338-13dd-4a95-b262-ef981d8fab00', 'volume_size': 1} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-536711916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d5338-13dd-4a95-b262-ef981d8fab00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b207699d20a441ba1d912eb76a6f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:29Z,use_quota=True,user_id='cd5a4466efd2491581b8c2c2d0220962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Creating volume 0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:29 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 1073741824 Sep 01 12:42:29 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:29 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 1073741824" returned: 0 in 0.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:29 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 Sep 01 12:42:29 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:29 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00" returned: 0 in 0.242s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8c6b43-1c26-4a88-8582-b839b9611af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6d5338-13dd-4a95-b262-ef981d8fab00', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f4bca5-3304-45dc-a842-1281c67b618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Volume volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 (0e6d5338-13dd-4a95-b262-ef981d8fab00): created successfully Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f4bca5-3304-45dc-a842-1281c67b618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Flow 'volume_create_manager' (44df526a-cb2e-4520-b8cb-15ad6be50d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c9f6f9e2-5a10-4397-a0c1-961d7c0ae6ad tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Created volume successfully. Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Creating offline snapshot 01e4e987-4095-42da-9145-57451d1a2b45 of volume 0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1f1fe-6edd-448d-a1dd-74ee12cfc3cf]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:30 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 Sep 01 12:42:30 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:30 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:30 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 1G Sep 01 12:42:30 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:31 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 1G" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:31 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 Sep 01 12:42:31 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:31 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45" returned: 0 in 0.365s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:31 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 is being set with open permissions: ugo+rw Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:31 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 Sep 01 12:42:31 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:31 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:31 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info Sep 01 12:42:31 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:32 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info" returned: 0 in 0.419s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:32 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info is being set with open permissions: ugo+rw Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:32 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info Sep 01 12:42:32 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (af9133ae-74af-46f0-945a-05a368601f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021dc4f7-b140-4c49-bbfd-99b4d94d39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021dc4f7-b140-4c49-bbfd-99b4d94d39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1463895157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7298358d-ee7a-4e38-94f8-b2fb75d69112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:32Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af42c3dd-83e7-478b-8d18-c6f66fb63c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af42c3dd-83e7-478b-8d18-c6f66fb63c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed423d4-fa92-4904-9c59-4d5f7c41edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed423d4-fa92-4904-9c59-4d5f7c41edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7298358d-ee7a-4e38-94f8-b2fb75d69112', 'volume_name': 'volume-7298358d-ee7a-4e38-94f8-b2fb75d69112', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cb49b-0d1d-417a-ab83-d2cd8e99e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cb49b-0d1d-417a-ab83-d2cd8e99e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a8927b-ce16-4345-b975-fcbc054dde0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Volume 7298358d-ee7a-4e38-94f8-b2fb75d69112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7298358d-ee7a-4e38-94f8-b2fb75d69112', 'volume_size': 1} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:32 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.info" returned: 0 in 0.310s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.248s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Creating offline snapshot 1e5c5361-6108-45e1-b3c7-b531f652b5d8 of volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc0969-c062-428e-a49f-ebbda0bcebae]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f5afd858-2cb0-4ef4-9ecb-6801a00055d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Create snapshot completed successfully Sep 01 12:42:32 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:32 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:33 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.363s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:33 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 1G Sep 01 12:42:33 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:33 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 1G" returned: 0 in 0.476s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:33 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:33 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:33 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.326s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:33 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 is being set with open permissions: ugo+rw Sep 01 12:42:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:33 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:33 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "cinder-01e4e987-4095-42da-9145-57451d1a2b45-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-01e4e987-4095-42da-9145-57451d1a2b45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "cinder-quobyte-01e4e987-4095-42da-9145-57451d1a2b45" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-01e4e987-4095-42da-9145-57451d1a2b45" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Deleting offline snapshot 01e4e987-4095-42da-9145-57451d1a2b45 of volume 0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] snapshot_file for this snap is: volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5348ed94-871b-4d34-b22b-a685b0a96b0f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:34 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.330s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:34 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info Sep 01 12:42:34 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 Sep 01 12:42:34 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:34 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info is being set with open permissions: ugo+rw Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:34 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info Sep 01 12:42:34 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e6d5338-13dd-4a95-b262-ef981d8fab00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[691424d7-323c-496d-a3f5-238793225858]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8cd81849-bbce-4ba0-b387-fddf3ec918c5 req-f7e72247-c534-45ed-97e5-bb654a9ba576 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:34 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 Sep 01 12:42:34 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.info" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1463895157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7298358d-ee7a-4e38-94f8-b2fb75d69112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:32Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Creating volume 7298358d-ee7a-4e38-94f8-b2fb75d69112 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:34 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 1073741824 Sep 01 12:42:34 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d6b832f9-528d-4c8e-adf9-928c19a6bb09 tempest-VolumesDeleteCascade-1320162602 None] Create snapshot completed successfully Sep 01 12:42:35 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:35 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 Sep 01 12:42:35 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:35 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 1073741824" returned: 0 in 0.459s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:35 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 Sep 01 12:42:35 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:35 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:35 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45 Sep 01 12:42:35 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:35 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8cd81849-bbce-4ba0-b387-fddf3ec918c5 req-f7e72247-c534-45ed-97e5-bb654a9ba576 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.950s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-8cd81849-bbce-4ba0-b387-fddf3ec918c5 req-f7e72247-c534-45ed-97e5-bb654a9ba576 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a8927b-ce16-4345-b975-fcbc054dde0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7298358d-ee7a-4e38-94f8-b2fb75d69112', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535654c6-9cb1-4133-babc-f4f4a4a95eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Volume volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 (7298358d-ee7a-4e38-94f8-b2fb75d69112): created successfully Sep 01 12:42:35 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535654c6-9cb1-4133-babc-f4f4a4a95eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (af9133ae-74af-46f0-945a-05a368601f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00.01e4e987-4095-42da-9145-57451d1a2b45" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5c21868c-7589-4466-a05d-04f04e76f7ba tempest-AttachVolumeNegativeTest-2061541993 None] Created volume successfully. Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-8cd81849-bbce-4ba0-b387-fddf3ec918c5 req-f7e72247-c534-45ed-97e5-bb654a9ba576 tempest-TestServerVolumeAttachmentScenario-680651441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-ff18e097-fae2-4991-b996-cee7020c84fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2a777dd-a4a9-497c-bd75-ac3855543062', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-01e4e987-4095-42da-9145-57451d1a2b45" released by "_delete_snapshot" :: held 1.606s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" released by "delete_snapshot" :: held 1.661s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-8cd81849-bbce-4ba0-b387-fddf3ec918c5 req-f7e72247-c534-45ed-97e5-bb654a9ba576 tempest-TestServerVolumeAttachmentScenario-680651441 None] attachment_update completed successfully. Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Created reservations ['bae266d8-1f26-4bc5-9a9c-1b3b9ce62351', 'b354fbe1-309e-4957-8375-c73513b693a6', '41248787-7fd4-40d1-b161-1c3dbffa555b', '013b0062-d297-4ff1-976e-4dd0e925ae94'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Creating offline snapshot 42e92aa5-d46c-47f1-b8f1-fcd05863328f of volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b718ab2-e4cb-4bd4-8519-bae42044978d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Delete snapshot completed successfully. Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d48ffe5a-f057-4e39-a991-a577094e9731 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-01e4e987-4095-42da-9145-57451d1a2b45-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:36 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:36 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "cinder-0e6d5338-13dd-4a95-b262-ef981d8fab00-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-0e6d5338-13dd-4a95-b262-ef981d8fab00-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" acquired by "delete_volume" :: waited 0.033s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:36 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cdf5d4-a735-4b4b-a46a-cbb906182433]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:36 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f 1G Sep 01 12:42:36 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:36 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 Sep 01 12:42:36 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:36 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:36 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00 Sep 01 12:42:36 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:37 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f 1G" returned: 0 in 0.622s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:37 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:37 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:37 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0e6d5338-13dd-4a95-b262-ef981d8fab00" returned: 0 in 0.278s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-quobyte-0e6d5338-13dd-4a95-b262-ef981d8fab00" released by "delete_volume" :: held 0.810s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Created reservations ['82af2ba6-368a-4e71-a903-799ee209528e', '2c90b033-0d36-489b-bda3-75bfcfe6821d', '9c9025e0-6aa8-4b85-93f6-f44e8392487b', '01ab21e2-feeb-4cae-9d34-62d0430de9ae'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:37 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:37 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:37 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.391s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f is being set with open permissions: ugo+rw Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:37 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:37 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:37 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.321s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Deleted volume successfully. Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-98c79a41-e897-4172-b92d-67280b7b93d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1029035789 None] Lock "cinder-0e6d5338-13dd-4a95-b262-ef981d8fab00-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0fa58efb-9c98-4cfa-886a-e82bd4e85087 req-ab5998f5-aa81-40f2-8c52-299a527c715e tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:37 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.354s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0fa58efb-9c98-4cfa-886a-e82bd4e85087 req-ab5998f5-aa81-40f2-8c52-299a527c715e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.055s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0fa58efb-9c98-4cfa-886a-e82bd4e85087 req-ab5998f5-aa81-40f2-8c52-299a527c715e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-07021195-e9c4-41a4-a083-a5b269ff52ae tempest-VolumesDeleteCascade-1320162602 None] Create snapshot completed successfully Sep 01 12:42:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-0fa58efb-9c98-4cfa-886a-e82bd4e85087 req-ab5998f5-aa81-40f2-8c52-299a527c715e tempest-AttachVolumeNegativeTest-2061541993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-7298358d-ee7a-4e38-94f8-b2fb75d69112', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b25b253a-041d-4ed7-8c58-f55bb4a89ce7', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:42:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0fa58efb-9c98-4cfa-886a-e82bd4e85087 req-ab5998f5-aa81-40f2-8c52-299a527c715e tempest-AttachVolumeNegativeTest-2061541993 None] attachment_update completed successfully. Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-3f5ce39f-b923-48b3-a908-a465e1a34cd3-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3f5ce39f-b923-48b3-a908-a465e1a34cd3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Performing cascade delete. {{(pid=87008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-1e5c5361-6108-45e1-b3c7-b531f652b5d8-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-1e5c5361-6108-45e1-b3c7-b531f652b5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-1e5c5361-6108-45e1-b3c7-b531f652b5d8" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-1e5c5361-6108-45e1-b3c7-b531f652b5d8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Deleting offline snapshot 1e5c5361-6108-45e1-b3c7-b531f652b5d8 of volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] snapshot_file for this snap is: volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b8fe9d-2cb8-46f1-a79d-5c2e2e488a2e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:38 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:38 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:38 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.465s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762ffee-ea93-4645-bb83-a20b3eeb0ac8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:39 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:39 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:39 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.466s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab5d5d-c82d-48c5-b662-92bedfb9e90f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:39 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:39 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:40 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a1e9b-6ff4-4f6b-805d-9fdbfcfd43f7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:40 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:40 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:40 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.583s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c75814-01bc-44db-be1c-ae2e38315e8a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:40 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:40 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:41 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.494s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:41 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:41 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:41 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.527s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:41 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8 Sep 01 12:42:41 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:42 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.1e5c5361-6108-45e1-b3c7-b531f652b5d8" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f -F qcow2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:42 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f -F qcow2 Sep 01 12:42:42 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:42 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f -F qcow2" returned: 0 in 0.418s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-1e5c5361-6108-45e1-b3c7-b531f652b5d8" released by "_delete_snapshot" :: held 4.061s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" released by "delete_snapshot" :: held 4.096s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['a9849cea-b3e1-4936-9dd4-afd0dcc52e95', 'e071059e-44a4-4822-8b4b-12ed50345f4a', '941c745d-7d49-425b-bf75-41b42976f20d', '24812ab6-1f2a-4fd4-baf4-11d435631d67'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Delete snapshot completed successfully. Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-1e5c5361-6108-45e1-b3c7-b531f652b5d8-delete_snapshot" released by "delete_snapshot" :: held 4.336s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-42e92aa5-d46c-47f1-b8f1-fcd05863328f-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-10dd2762-1df4-4dc3-873b-75960929391d req-15d87d29-c051-4c51-8c67-c9b5e675a3df tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-10dd2762-1df4-4dc3-873b-75960929391d req-15d87d29-c051-4c51-8c67-c9b5e675a3df tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-42e92aa5-d46c-47f1-b8f1-fcd05863328f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-10dd2762-1df4-4dc3-873b-75960929391d req-15d87d29-c051-4c51-8c67-c9b5e675a3df tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-42e92aa5-d46c-47f1-b8f1-fcd05863328f" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-42e92aa5-d46c-47f1-b8f1-fcd05863328f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Deleting offline snapshot 42e92aa5-d46c-47f1-b8f1-fcd05863328f of volume 3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] snapshot_file for this snap is: volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-10dd2762-1df4-4dc3-873b-75960929391d req-15d87d29-c051-4c51-8c67-c9b5e675a3df tempest-TestServerVolumeAttachmentScenario-680651441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-230e709b-4184-4298-b45f-cbe6c5c20cfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '687cdabf-dc7e-430c-acfb-3415ef690331', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79ce06-6ced-4e91-812a-78a20bd92eea]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-10dd2762-1df4-4dc3-873b-75960929391d req-15d87d29-c051-4c51-8c67-c9b5e675a3df tempest-TestServerVolumeAttachmentScenario-680651441 None] attachment_update completed successfully. Sep 01 12:42:43 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:43 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:43 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.544s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201d059-4bea-4472-941a-23a4a1b471d1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:43 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:43 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:44 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.506s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:44 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:44 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:44 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:44 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f Sep 01 12:42:44 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:44 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3.42e92aa5-d46c-47f1-b8f1-fcd05863328f" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-42e92aa5-d46c-47f1-b8f1-fcd05863328f" released by "_delete_snapshot" :: held 1.937s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" released by "delete_snapshot" :: held 1.977s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:44 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['7b7eefeb-cd32-4308-9e7e-c86191b86241', '4451fd1f-b925-463f-8390-f3a04206008e', '24231a5b-95e7-4c43-a902-0a75d3e524b2', '640624b0-d5c4-4a37-8754-9e259bec755d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:45 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Delete snapshot completed successfully. Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-42e92aa5-d46c-47f1-b8f1-fcd05863328f-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Snapshots deleted, issuing volume delete {{(pid=87008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f1a3a-ab58-4150-815d-0fa76fe80bc5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:45 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:45 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:45 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.648s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:45 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3 Sep 01 12:42:45 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:45 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-899c7538-42d2-4ce5-87bd-6eb5eae0a76c req-4989e937-e097-4407-9f5e-702f1824d07b tempest-TestServerVolumeAttachmentScenario-680651441 None] Terminate volume connection completed successfully. Sep 01 12:42:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-899c7538-42d2-4ce5-87bd-6eb5eae0a76c req-4989e937-e097-4407-9f5e-702f1824d07b tempest-TestServerVolumeAttachmentScenario-680651441 None] Deleting attachment 687cdabf-dc7e-430c-acfb-3415ef690331. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:42:46 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f5ce39f-b923-48b3-a908-a465e1a34cd3" returned: 0 in 0.498s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f5ce39f-b923-48b3-a908-a465e1a34cd3" released by "delete_volume" :: held 1.261s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['eca3687d-c4e7-4bfe-a515-5309fde9f327', '7b2a49bd-8bfd-4bcf-8793-fad259bb5a17', 'db2f8a17-4378-409c-a926-d56e4cef1795', '4e594706-6b91-4127-9ec1-e39991ed07e1'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:46 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:46 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:46 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.354s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:46 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Deleted volume successfully. Sep 01 12:42:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d66f0a46-8ce8-4116-bcb5-75e3a6c94a66 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3f5ce39f-b923-48b3-a908-a465e1a34cd3-delete_volume" released by "delete_volume" :: held 8.719s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-733d3112-a5a9-4197-85c1-6f3f984bc6d9 req-ad95c1fc-0b38-4972-ac62-755628b8f39b tempest-TestServerVolumeAttachmentScenario-680651441 None] Terminate volume connection completed successfully. Sep 01 12:42:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-733d3112-a5a9-4197-85c1-6f3f984bc6d9 req-ad95c1fc-0b38-4972-ac62-755628b8f39b tempest-TestServerVolumeAttachmentScenario-680651441 None] Deleting attachment a2a777dd-a4a9-497c-bd75-ac3855543062. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (1641dfee-8b79-42b9-827a-1a326e08970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760303ee-51eb-48c6-bd0c-213b5e12aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760303ee-51eb-48c6-bd0c-213b5e12aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937165331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f43ff91-56cb-4743-868c-7c35d83ccfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca348c4678b142f1a3e05eaf7c15c734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:48Z,use_quota=True,user_id='40bed3b98bb94a83ac0e520c60fdac7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba367c2c-53aa-4970-a10c-55014ac062ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba367c2c-53aa-4970-a10c-55014ac062ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0aa4f6-e2e7-4aeb-b881-87b1d593a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0aa4f6-e2e7-4aeb-b881-87b1d593a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f43ff91-56cb-4743-868c-7c35d83ccfdb', 'volume_name': 'volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba109004-3758-4f0c-99d2-097651fcac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba109004-3758-4f0c-99d2-097651fcac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16b2c4e-24af-46aa-96fb-1cbdeca3f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:48 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Volume 3f43ff91-56cb-4743-868c-7c35d83ccfdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb', 'volume_size': 1} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937165331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f43ff91-56cb-4743-868c-7c35d83ccfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca348c4678b142f1a3e05eaf7c15c734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:48Z,use_quota=True,user_id='40bed3b98bb94a83ac0e520c60fdac7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Creating volume 3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:48 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:42:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:48 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb 1073741824 Sep 01 12:42:48 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:49 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb 1073741824" returned: 0 in 0.669s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:49 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:42:49 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:49 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.438s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16b2c4e-24af-46aa-96fb-1cbdeca3f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94e1c7-9791-4b18-a2f3-00cdfa77fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Volume volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb (3f43ff91-56cb-4743-868c-7c35d83ccfdb): created successfully Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d94e1c7-9791-4b18-a2f3-00cdfa77fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (1641dfee-8b79-42b9-827a-1a326e08970e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:49 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-eb9d6afc-2817-4ac9-aabf-f01db256e1ab tempest-VolumesDeleteCascade-1320162602 None] Created volume successfully. Sep 01 12:42:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Creating offline snapshot 3482f25d-2215-4782-b818-c9b40b079b34 of volume 3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:42:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d8a4e-b4e7-4b4c-9c25-40f97e5045e8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:51 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:42:51 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:51 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.803s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:51 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 1G Sep 01 12:42:51 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:52 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 1G" returned: 0 in 0.750s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:52 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:42:52 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:53 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.564s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:53 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 is being set with open permissions: ugo+rw Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:53 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:42:53 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:53 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:53 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info Sep 01 12:42:53 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:53 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:53 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info is being set with open permissions: ugo+rw Sep 01 12:42:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:53 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info Sep 01 12:42:53 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:54 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "cinder-230e709b-4184-4298-b45f-cbe6c5c20cfb-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.info" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.398s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-230e709b-4184-4298-b45f-cbe6c5c20cfb-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a30779f4-45df-4caf-b581-7eba3b3e711c tempest-VolumesDeleteCascade-1320162602 None] Create snapshot completed successfully Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "cinder-quobyte-230e709b-4184-4298-b45f-cbe6c5c20cfb" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-quobyte-230e709b-4184-4298-b45f-cbe6c5c20cfb" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b0ddf-92c4-4bb1-a630-52ff57370ab1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:54 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb Sep 01 12:42:54 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:54 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb" returned: 0 in 0.477s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:54 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb Sep 01 12:42:54 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:55 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-230e709b-4184-4298-b45f-cbe6c5c20cfb" returned: 0 in 0.536s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-quobyte-230e709b-4184-4298-b45f-cbe6c5c20cfb" released by "delete_volume" :: held 1.110s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Created reservations ['1104090b-48d3-4328-a3f5-41483a7998f2', 'b334b7d5-da66-4302-bc74-4fe6225a1fbb', '20a97b3d-cc6d-421a-8f33-34852b775a4e', 'a891dc0f-d757-4827-8023-89c95d20288e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:55 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:55 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (b5144335-8d30-494a-882c-8bdf85b7f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3c132c-8d21-408d-9d1d-3ba2fb9cddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3c132c-8d21-408d-9d1d-3ba2fb9cddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-327514500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa60b92-26d9-401c-baa5-c0c3fe44aadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca348c4678b142f1a3e05eaf7c15c734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3482f25d-2215-4782-b818-c9b40b079b34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:56Z,use_quota=True,user_id='40bed3b98bb94a83ac0e520c60fdac7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7441be-bd7d-4d48-9ede-7ed37b359049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7441be-bd7d-4d48-9ede-7ed37b359049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecba63c-c58c-4bc4-9121-e21121e2cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecba63c-c58c-4bc4-9121-e21121e2cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'daa60b92-26d9-401c-baa5-c0c3fe44aadf', 'volume_name': 'volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf', 'volume_size': 1, 'snapshot_id': '3482f25d-2215-4782-b818-c9b40b079b34'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdedca53-7c2e-4a79-b70a-7f788ee28a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdedca53-7c2e-4a79-b70a-7f788ee28a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff73553-f346-498f-bdfd-f02649ca368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Volume daa60b92-26d9-401c-baa5-c0c3fe44aadf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf', 'volume_size': 1, 'snapshot_id': '3482f25d-2215-4782-b818-c9b40b079b34'} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34-daa60b92-26d9-401c-baa5-c0c3fe44aadf" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34-daa60b92-26d9-401c-baa5-c0c3fe44aadf" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Creating volume daa60b92-26d9-401c-baa5-c0c3fe44aadf from snapshot 3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] snapshot: 3482f25d-2215-4782-b818-c9b40b079b34, volume: daa60b92-26d9-401c-baa5-c0c3fe44aadf, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:56 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.662s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Deleted volume successfully. Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[34775a7f-d9e3-469b-85c2-39fb589bdaf7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6aabc74f-3c04-42f0-910d-db03f17ddcd5 tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-230e709b-4184-4298-b45f-cbe6c5c20cfb-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:56 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:42:56 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "cinder-ff18e097-fae2-4991-b996-cee7020c84fd-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-ff18e097-fae2-4991-b996-cee7020c84fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "cinder-quobyte-ff18e097-fae2-4991-b996-cee7020c84fd" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-quobyte-ff18e097-fae2-4991-b996-cee7020c84fd" acquired by "delete_volume" :: waited 0.037s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ddf4aa-e6fa-4652-b8bd-a0c08c3ed8e0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:57 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.725s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:42:57 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd Sep 01 12:42:57 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[293bc497-b971-4d4c-b4d8-319cd886dfab]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:42:57 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Flow 'volume_create_manager' (127ee16c-f8a3-4813-96f8-a14184174d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:42:57 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c59f26-b9dc-4cec-87b4-bd237b3842c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c59f26-b9dc-4cec-87b4-bd237b3842c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1162934169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b380469e-627f-4780-91d8-146d170a1dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3803ebf67a174dcabd00308346458412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:57Z,use_quota=True,user_id='911a5e04f7b54dd9ac6ca05d06722a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cfa796-92e5-41bb-8c07-2dd9ebaeaebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cfa796-92e5-41bb-8c07-2dd9ebaeaebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8041c4-c250-41a8-ab3c-157a08b56d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8041c4-c250-41a8-ab3c-157a08b56d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b380469e-627f-4780-91d8-146d170a1dec', 'volume_name': 'volume-b380469e-627f-4780-91d8-146d170a1dec', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be34bb74-204f-4ddd-b2fc-482143630b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be34bb74-204f-4ddd-b2fc-482143630b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99850737-2733-45ab-8ec7-ef900b30d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:42:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Volume b380469e-627f-4780-91d8-146d170a1dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b380469e-627f-4780-91d8-146d170a1dec', 'volume_size': 1} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:57 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd" returned: 0 in 0.569s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:57 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd Sep 01 12:42:57 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:57 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.553s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:57 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf Sep 01 12:42:57 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:57 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ff18e097-fae2-4991-b996-cee7020c84fd" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-quobyte-ff18e097-fae2-4991-b996-cee7020c84fd" released by "delete_volume" :: held 0.952s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:42:57 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Created reservations ['bd5400b4-eed4-4c8d-a373-ead75e97fb67', '9a7112bd-5848-4fb6-bf92-1a333524961d', 'fc40c5d0-1e79-48f8-a1fc-dbe5ec157960', '2ce35033-4744-426f-9831-a70222e6caf3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:42:58 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:42:58 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:42:58 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.658s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:42:58 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Deleted volume successfully. Sep 01 12:42:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f2fd77fe-b089-44b5-a25d-4f71f3fe9f7c tempest-TestServerVolumeAttachmentScenario-680651441 None] Lock "cinder-ff18e097-fae2-4991-b996-cee7020c84fd-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:04 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf" returned: 0 in 6.348s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:43:04 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Converted 1024.00 MB image at 161.28 MB/s Sep 01 12:43:04 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf is being set with open permissions: ugo+rw Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:04 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf Sep 01 12:43:04 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:04 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf" returned: 0 in 0.283s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" released by "_copy_volume_from_snapshot" :: held 8.059s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34-daa60b92-26d9-401c-baa5-c0c3fe44aadf" released by "_create_volume_from_snapshot" :: held 8.164s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.191s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.993s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1162934169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b380469e-627f-4780-91d8-146d170a1dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3803ebf67a174dcabd00308346458412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:42:57Z,use_quota=True,user_id='911a5e04f7b54dd9ac6ca05d06722a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Creating volume b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:04 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:04 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec 1073741824 Sep 01 12:43:04 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff73553-f346-498f-bdfd-f02649ca368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf', 'volume_size': 1, 'snapshot_id': '3482f25d-2215-4782-b818-c9b40b079b34'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff99b863-7463-4863-8298-5f1904f9c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:04 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Volume volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf (daa60b92-26d9-401c-baa5-c0c3fe44aadf): created successfully Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff99b863-7463-4863-8298-5f1904f9c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Flow 'volume_create_manager' (b5144335-8d30-494a-882c-8bdf85b7f445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-42ad0afd-4dc8-4342-bff2-a5e76266d8ef tempest-VolumesDeleteCascade-1320162602 None] Created volume successfully. Sep 01 12:43:04 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec 1073741824" returned: 0 in 0.553s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:05 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec Sep 01 12:43:05 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-3f43ff91-56cb-4743-868c-7c35d83ccfdb-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3f43ff91-56cb-4743-868c-7c35d83ccfdb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Performing cascade delete. {{(pid=87008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-3482f25d-2215-4782-b818-c9b40b079b34-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3482f25d-2215-4782-b818-c9b40b079b34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:05 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec" returned: 0 in 0.388s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Deleting offline snapshot 3482f25d-2215-4782-b818-c9b40b079b34 of volume 3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] snapshot_file for this snap is: volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99850737-2733-45ab-8ec7-ef900b30d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b380469e-627f-4780-91d8-146d170a1dec', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0c4bc2-db9f-4c61-9a54-02c751d7d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[76311b4e-4ffa-49ae-ba89-458af3437168]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:05 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Volume volume-b380469e-627f-4780-91d8-146d170a1dec (b380469e-627f-4780-91d8-146d170a1dec): created successfully Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0c4bc2-db9f-4c61-9a54-02c751d7d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Flow 'volume_create_manager' (127ee16c-f8a3-4813-96f8-a14184174d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e62e190c-50dc-46dd-86ac-db11c54cbed5 tempest-SnapshotMetadataTestJSON-304825556 None] Created volume successfully. Sep 01 12:43:05 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:43:05 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:05 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d40b63-dc48-4e3b-a03c-032373eff5af]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:05 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:43:05 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:06 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.633s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:06 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:43:06 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Creating offline snapshot 430596dd-ed80-48bf-a009-5fb0e6cab1ac of volume b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054f673-6bfb-4c83-b4d3-bb2187743eeb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:06 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec Sep 01 12:43:06 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:06 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.411s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:06 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34 Sep 01 12:43:06 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:07 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:07 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac 1G Sep 01 12:43:07 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:07 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb.3482f25d-2215-4782-b818-c9b40b079b34" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3482f25d-2215-4782-b818-c9b40b079b34" released by "_delete_snapshot" :: held 1.805s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" released by "delete_snapshot" :: held 1.833s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['e43636bc-dd0b-4914-93ec-07ec5aaff770', '4e865235-851c-4b52-a00a-83bb77ef7ed8', '14d449a6-a7c2-4285-b7a3-5c7b54aa485d', 'd4414983-f977-4594-a153-9e87530e9491'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Delete snapshot completed successfully. Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3482f25d-2215-4782-b818-c9b40b079b34-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Snapshots deleted, issuing volume delete {{(pid=87008) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ca8dd-ed46-4cca-8c33-bfe22d161c77]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:07 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:43:07 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:07 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac 1G" returned: 0 in 0.541s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b380469e-627f-4780-91d8-146d170a1dec -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:07 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b380469e-627f-4780-91d8-146d170a1dec -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac Sep 01 12:43:07 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:07 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.398s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:07 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb Sep 01 12:43:07 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:07 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b380469e-627f-4780-91d8-146d170a1dec -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac" returned: 0 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:07 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac is being set with open permissions: ugo+rw Sep 01 12:43:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:08 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac Sep 01 12:43:08 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:08 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3f43ff91-56cb-4743-868c-7c35d83ccfdb" returned: 0 in 0.316s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-3f43ff91-56cb-4743-868c-7c35d83ccfdb" released by "delete_volume" :: held 0.788s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:08 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['871a8d38-d656-4616-9913-70d25a9828ae', 'c6fa5fc3-071b-4f01-b981-9e68013c28ae', '63bbf39b-0b46-4457-9fc2-7e24c3b6f960', '27d5d8f1-e8e8-42b8-afef-7251802f8079'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:08 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info Sep 01 12:43:08 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:08 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:08 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:08 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info" returned: 0 in 0.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:08 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info is being set with open permissions: ugo+rw Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:08 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info Sep 01 12:43:08 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:08 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.316s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Deleted volume successfully. Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ceda3c1-3593-4b5f-b73e-6f4475b620de tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-3f43ff91-56cb-4743-868c-7c35d83ccfdb-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-daa60b92-26d9-401c-baa5-c0c3fe44aadf-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-daa60b92-26d9-401c-baa5-c0c3fe44aadf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:08 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.info" returned: 0 in 0.298s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" acquired by "delete_volume" :: waited 0.033s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b734772a-0c6f-4061-8638-58e04f1e9ac8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c83db9af-7d94-4a65-86d8-ec1833ca2fe2 tempest-SnapshotMetadataTestJSON-304825556 None] Create snapshot completed successfully Sep 01 12:43:09 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf Sep 01 12:43:09 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:09 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf" returned: 0 in 0.388s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:09 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf Sep 01 12:43:09 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:09 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daa60b92-26d9-401c-baa5-c0c3fe44aadf" returned: 0 in 0.249s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-quobyte-daa60b92-26d9-401c-baa5-c0c3fe44aadf" released by "delete_volume" :: held 0.681s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Created reservations ['86a8ba26-f43e-43cd-9e1b-a00439b9d70f', '5f52b9d5-b82c-4152-9fb6-4f55e891672f', 'fc17dc75-597e-4673-9baf-751e18692d9e', '9ceb7994-f0ae-4be0-9576-2c4321a9f0a2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:09 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:09 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:10 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.405s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Deleted volume successfully. Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb130b8-1eb6-49b8-bf2a-0fcfae626ae5 tempest-VolumesDeleteCascade-1320162602 None] Lock "cinder-daa60b92-26d9-401c-baa5-c0c3fe44aadf-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "cinder-430596dd-ed80-48bf-a009-5fb0e6cab1ac-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-430596dd-ed80-48bf-a009-5fb0e6cab1ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "cinder-quobyte-430596dd-ed80-48bf-a009-5fb0e6cab1ac" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-430596dd-ed80-48bf-a009-5fb0e6cab1ac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Deleting offline snapshot 430596dd-ed80-48bf-a009-5fb0e6cab1ac of volume b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] snapshot_file for this snap is: volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dbc939-c28e-4cc5-b1f3-efeb746294d0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:11 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac Sep 01 12:43:11 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:11 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac" returned: 0 in 0.700s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b380469e-627f-4780-91d8-146d170a1dec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:43:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8543ed11-d6d8-4383-b31d-3d545ab2888d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:11 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec Sep 01 12:43:11 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:12 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec" returned: 0 in 0.548s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:12 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac Sep 01 12:43:12 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:12 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac" returned: 0 in 0.603s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:12 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac Sep 01 12:43:12 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:13 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec.430596dd-ed80-48bf-a009-5fb0e6cab1ac" returned: 0 in 0.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-430596dd-ed80-48bf-a009-5fb0e6cab1ac" released by "_delete_snapshot" :: held 2.356s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" released by "delete_snapshot" :: held 2.397s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:13 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Created reservations ['dfb47245-a651-45bc-b3cf-e7b71d9a42c2', '6087dd5e-8357-426a-acb1-a725ccd6ec45', '428573b2-72a8-46d6-b63e-1003bbef646f', '7bc4b63c-a1f4-4100-8ac5-53e48ae0f40e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Delete snapshot completed successfully. Sep 01 12:43:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-346de98b-611b-4f3e-8b97-b6010385c987 tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-430596dd-ed80-48bf-a009-5fb0e6cab1ac-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "cinder-b380469e-627f-4780-91d8-146d170a1dec-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-b380469e-627f-4780-91d8-146d170a1dec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[952849b6-b484-4192-bfdf-dbd0e44061a5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:14 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec Sep 01 12:43:14 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:14 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec" returned: 0 in 0.453s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:14 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec Sep 01 12:43:14 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:15 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b380469e-627f-4780-91d8-146d170a1dec" returned: 0 in 0.293s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-quobyte-b380469e-627f-4780-91d8-146d170a1dec" released by "delete_volume" :: held 0.837s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Created reservations ['be72264d-09c2-4772-8610-13076867b6cd', 'e5730b9b-523a-4fe5-9aa2-abe41b316f0a', '458c355a-3b0c-478d-bbbd-be629610797e', '29cf95b2-2100-4212-b499-86af528db0c3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:15 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:15 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:15 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Deleted volume successfully. Sep 01 12:43:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8dbda766-7d4c-423d-b78c-59ded218211e tempest-SnapshotMetadataTestJSON-304825556 None] Lock "cinder-b380469e-627f-4780-91d8-146d170a1dec-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Flow 'volume_create_manager' (71813f22-66aa-4cc8-8bf0-4b9a6275b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a936572-e346-44cc-b897-28f903525511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a936572-e346-44cc-b897-28f903525511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1871277906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce112fa2-0eb6-4af2-81ea-a570becdd137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777f09565e540c2b169ba3050297650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:17Z,use_quota=True,user_id='6727882dc1af48fb8fc56cc7759727a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b2955-ccf8-44a8-88b9-e4a5574d95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b2955-ccf8-44a8-88b9-e4a5574d95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91739496-3b9a-4038-aadd-81c2964fa46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91739496-3b9a-4038-aadd-81c2964fa46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce112fa2-0eb6-4af2-81ea-a570becdd137', 'volume_name': 'volume-ce112fa2-0eb6-4af2-81ea-a570becdd137', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c59a3da-9b55-4d3c-aa0b-7aa7ba8bfc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c59a3da-9b55-4d3c-aa0b-7aa7ba8bfc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81761fa1-fea5-479c-84c5-77891964c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Volume ce112fa2-0eb6-4af2-81ea-a570becdd137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce112fa2-0eb6-4af2-81ea-a570becdd137', 'volume_size': 1} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1871277906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce112fa2-0eb6-4af2-81ea-a570becdd137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777f09565e540c2b169ba3050297650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:17Z,use_quota=True,user_id='6727882dc1af48fb8fc56cc7759727a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Creating volume ce112fa2-0eb6-4af2-81ea-a570becdd137 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:17 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:17 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 1073741824 Sep 01 12:43:17 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:17 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 1073741824" returned: 0 in 0.807s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:18 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 Sep 01 12:43:18 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:18 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137" returned: 0 in 0.457s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81761fa1-fea5-479c-84c5-77891964c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce112fa2-0eb6-4af2-81ea-a570becdd137', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e95038-230d-416d-b794-97f43754ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Volume volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 (ce112fa2-0eb6-4af2-81ea-a570becdd137): created successfully Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e95038-230d-416d-b794-97f43754ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Flow 'volume_create_manager' (71813f22-66aa-4cc8-8bf0-4b9a6275b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-695ba1d6-6a61-4452-95fa-665c0a87c774 tempest-VolumesTransfersV355Test-1668857283 None] Created volume successfully. Sep 01 12:43:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1140501e-04a3-4efc-9973-efa4833f6cca tempest-VolumesTransfersV355Test-1936699853 None] Transfer volume completed successfully. Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "cinder-ce112fa2-0eb6-4af2-81ea-a570becdd137-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-ce112fa2-0eb6-4af2-81ea-a570becdd137-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "cinder-quobyte-ce112fa2-0eb6-4af2-81ea-a570becdd137" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-quobyte-ce112fa2-0eb6-4af2-81ea-a570becdd137" acquired by "delete_volume" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[32596717-965f-4e41-b053-1288468ab713]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:21 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 Sep 01 12:43:21 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:21 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:21 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137 Sep 01 12:43:21 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:22 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ce112fa2-0eb6-4af2-81ea-a570becdd137" returned: 0 in 0.455s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-quobyte-ce112fa2-0eb6-4af2-81ea-a570becdd137" released by "delete_volume" :: held 1.000s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Flow 'volume_create_manager' (97a8a263-ff23-47a7-9575-34dd1c7a441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41273e13-0b34-40e3-a7a5-c62589e219bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41273e13-0b34-40e3-a7a5-c62589e219bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1044593666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a464d6-9e3b-4de6-9d42-7420a22f4c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac108963bb43d785b1fd767a569182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:22Z,use_quota=True,user_id='e3955b32b9644be6940ddae4e281622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b96d1-3ffb-4c95-952f-9df6c13a6b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b96d1-3ffb-4c95-952f-9df6c13a6b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5ec1f-8f44-4961-afa1-7ea3ef43e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5ec1f-8f44-4961-afa1-7ea3ef43e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a464d6-9e3b-4de6-9d42-7420a22f4c4e', 'volume_name': 'volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859baf5c-a147-4e79-9f36-cb12c8002363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859baf5c-a147-4e79-9f36-cb12c8002363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab89ad38-594e-44c5-bfc7-2369756674a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Volume b7a464d6-9e3b-4de6-9d42-7420a22f4c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e', 'volume_size': 1} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1044593666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a464d6-9e3b-4de6-9d42-7420a22f4c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac108963bb43d785b1fd767a569182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:22Z,use_quota=True,user_id='e3955b32b9644be6940ddae4e281622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Creating volume b7a464d6-9e3b-4de6-9d42-7420a22f4c4e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:22 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:22 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e 1073741824 Sep 01 12:43:22 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Created reservations ['0d28b323-8ff1-4795-9e12-5c6e87b028ec', 'dfcaf099-4e20-4903-a150-b50a74e9613f', '2672a676-8293-4a82-914c-3ec5c5fdfe61', '531b168c-eaf2-4bb1-861d-cd09a6b3a64e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:22 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:22 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-8e62c704-5c99-41bb-9895-47f78ec07bf8 req-cf489b3d-82dc-40b3-9efb-4d62e8c820cf tempest-AttachVolumeNegativeTest-2061541993 None] Terminate volume connection completed successfully. Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-8e62c704-5c99-41bb-9895-47f78ec07bf8 req-cf489b3d-82dc-40b3-9efb-4d62e8c820cf tempest-AttachVolumeNegativeTest-2061541993 None] Deleting attachment b25b253a-041d-4ed7-8c58-f55bb4a89ce7. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:43:22 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Deleted volume successfully. Sep 01 12:43:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e5b144c6-5133-4ac9-b455-98617aa3fb06 tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-ce112fa2-0eb6-4af2-81ea-a570becdd137-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:23 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e 1073741824" returned: 0 in 0.564s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:23 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e Sep 01 12:43:23 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:23 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab89ad38-594e-44c5-bfc7-2369756674a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb4d196-daba-4c38-bbc2-26f12bd8bb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Volume volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e (b7a464d6-9e3b-4de6-9d42-7420a22f4c4e): created successfully Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb4d196-daba-4c38-bbc2-26f12bd8bb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Flow 'volume_create_manager' (97a8a263-ff23-47a7-9575-34dd1c7a441d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f48f6edd-f593-440c-a709-ad6101b690a8 tempest-VolumesTransfersTest-445797890 None] Created volume successfully. Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Flow 'volume_create_manager' (f1e6c11b-e60b-43cf-8257-15f1cc1d10f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7627b8b-19f0-424c-87ec-443ff403f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7627b8b-19f0-424c-87ec-443ff403f272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1432524325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c8bd1d-263c-41f3-96b0-c3b796bd1289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777f09565e540c2b169ba3050297650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:25Z,use_quota=True,user_id='6727882dc1af48fb8fc56cc7759727a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8924cb-ce77-47cd-a4df-f0dffe415084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8924cb-ce77-47cd-a4df-f0dffe415084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a255a481-597f-4b38-9ce3-fe199156f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a255a481-597f-4b38-9ce3-fe199156f34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c8bd1d-263c-41f3-96b0-c3b796bd1289', 'volume_name': 'volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3028a6-ff1d-4226-843d-791748aa6c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3028a6-ff1d-4226-843d-791748aa6c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db42b4f8-8a04-4f94-83f3-a69dba5a2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Volume 82c8bd1d-263c-41f3-96b0-c3b796bd1289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289', 'volume_size': 1} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1432524325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c8bd1d-263c-41f3-96b0-c3b796bd1289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777f09565e540c2b169ba3050297650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:25Z,use_quota=True,user_id='6727882dc1af48fb8fc56cc7759727a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Creating volume 82c8bd1d-263c-41f3-96b0-c3b796bd1289 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:24 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 1073741824 Sep 01 12:43:24 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:25 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 1073741824" returned: 0 in 0.621s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2effc78c-3484-415e-81b4-360808d8aad7 tempest-VolumesTransfersTest-1090840745 None] Transfer volume completed successfully. Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:25 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 Sep 01 12:43:25 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:25 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db42b4f8-8a04-4f94-83f3-a69dba5a2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11d56b6-7481-45fc-928c-f65d659c7d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:25 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Volume volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 (82c8bd1d-263c-41f3-96b0-c3b796bd1289): created successfully Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11d56b6-7481-45fc-928c-f65d659c7d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Flow 'volume_create_manager' (f1e6c11b-e60b-43cf-8257-15f1cc1d10f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d28985c9-c317-4ae2-ba34-d83434249660 tempest-VolumesTransfersV355Test-1668857283 None] Created volume successfully. Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "cinder-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=134,cinder:UPDATE=128,cinder:DELETE=15,cinder:INSERT=32 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "cinder-quobyte-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-quobyte-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6425eb97-dee8-4757-8ed3-e3f53b232e01]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:26 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e Sep 01 12:43:26 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:26 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:26 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:26 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" returned: 0 in 0.637s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:26 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e Sep 01 12:43:26 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:27 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.633s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:43:27 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "cinder-82c8bd1d-263c-41f3-96b0-c3b796bd1289-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-quobyte-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e" released by "delete_volume" :: held 1.131s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=133,cinder:SELECT=122,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-82c8bd1d-263c-41f3-96b0-c3b796bd1289-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "cinder-quobyte-82c8bd1d-263c-41f3-96b0-c3b796bd1289" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-quobyte-82c8bd1d-263c-41f3-96b0-c3b796bd1289" acquired by "delete_volume" :: waited 0.057s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae08273-5360-486a-98b5-ab579abca5b7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Created reservations ['42e35cc2-08cb-4c23-9965-54deb5f12f72', '1e0ae290-7ba1-4434-8abd-f7d2d2259114', '00a3285f-8286-46e9-91b3-5391a5e03981', '5c77f701-a5a0-4869-828b-d84c66564ea0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:27 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 Sep 01 12:43:27 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:27 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:27 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:28 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.353s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Deleted volume successfully. Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ca7512c-68b6-40d4-b551-3a93cf223767 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-b7a464d6-9e3b-4de6-9d42-7420a22f4c4e-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:28 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289" returned: 0 in 0.571s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:28 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289 Sep 01 12:43:28 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:28 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-82c8bd1d-263c-41f3-96b0-c3b796bd1289" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-quobyte-82c8bd1d-263c-41f3-96b0-c3b796bd1289" released by "delete_volume" :: held 0.989s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Created reservations ['3c6d060a-220a-4c41-80f1-c68da67994c4', 'c14a5756-002c-4781-b4fa-46656e8f65ca', '9fd33ed4-d7a4-4c44-b9f7-62e3be01b6f6', '5797e280-8c66-459f-a76d-0696feafbcfb'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:28 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:28 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:29 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Deleted volume successfully. Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7e57e3e7-bb7e-4816-bc05-60485eeca0ac tempest-VolumesTransfersV355Test-1623397460 None] Lock "cinder-82c8bd1d-263c-41f3-96b0-c3b796bd1289-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Flow 'volume_create_manager' (a4079994-bf4c-4588-967b-7d0cfe67e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ceaf32-e2dc-48b4-9738-31c67087a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ceaf32-e2dc-48b4-9738-31c67087a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-549937805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aec304a-17df-46c9-b36b-a52d7402f3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac108963bb43d785b1fd767a569182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:29Z,use_quota=True,user_id='e3955b32b9644be6940ddae4e281622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee60df24-75ba-4a4c-a2df-912f7e58c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee60df24-75ba-4a4c-a2df-912f7e58c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1539b87e-d303-4b85-b998-80aec30b5d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1539b87e-d303-4b85-b998-80aec30b5d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aec304a-17df-46c9-b36b-a52d7402f3a3', 'volume_name': 'volume-4aec304a-17df-46c9-b36b-a52d7402f3a3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce41df-429e-47ee-9359-b4bbd4a2f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ce41df-429e-47ee-9359-b4bbd4a2f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc2de9-8fc9-453f-b0e8-96da4189931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Volume 4aec304a-17df-46c9-b36b-a52d7402f3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aec304a-17df-46c9-b36b-a52d7402f3a3', 'volume_size': 1} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-549937805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aec304a-17df-46c9-b36b-a52d7402f3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac108963bb43d785b1fd767a569182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:29Z,use_quota=True,user_id='e3955b32b9644be6940ddae4e281622a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Creating volume 4aec304a-17df-46c9-b36b-a52d7402f3a3 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:29 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:29 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 1073741824 Sep 01 12:43:29 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:30 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 1073741824" returned: 0 in 0.600s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:30 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 Sep 01 12:43:30 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:30 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3" returned: 0 in 0.487s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc2de9-8fc9-453f-b0e8-96da4189931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aec304a-17df-46c9-b36b-a52d7402f3a3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a52f356-bb3a-4dec-8e4a-b012c549cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Volume volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 (4aec304a-17df-46c9-b36b-a52d7402f3a3): created successfully Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a52f356-bb3a-4dec-8e4a-b012c549cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Flow 'volume_create_manager' (a4079994-bf4c-4588-967b-7d0cfe67e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2b5dab1f-3b3c-4905-b93b-a0bc0145a859 tempest-VolumesTransfersTest-445797890 None] Created volume successfully. Sep 01 12:43:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "cinder-4aec304a-17df-46c9-b36b-a52d7402f3a3-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-4aec304a-17df-46c9-b36b-a52d7402f3a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "cinder-quobyte-4aec304a-17df-46c9-b36b-a52d7402f3a3" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-quobyte-4aec304a-17df-46c9-b36b-a52d7402f3a3" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5215398-b97a-4827-8095-6cf9d684a24a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:32 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 Sep 01 12:43:32 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:32 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:32 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3 Sep 01 12:43:32 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:32 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4aec304a-17df-46c9-b36b-a52d7402f3a3" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-quobyte-4aec304a-17df-46c9-b36b-a52d7402f3a3" released by "delete_volume" :: held 0.775s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Created reservations ['10c5a08a-f266-47c4-8d7b-0989fb844392', '0b3bf8df-8e48-4858-bd4e-2880842f934b', '36bf9fcf-95c7-47b3-9fcd-803981fcb185', '88feeb63-5dea-433c-a15e-abac23ff0e71'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:32 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:32 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:33 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.335s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:33 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Deleted volume successfully. Sep 01 12:43:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2eb580f6-758d-4ab7-96cf-ea785e3a96c1 tempest-VolumesTransfersTest-1754918538 None] Lock "cinder-4aec304a-17df-46c9-b36b-a52d7402f3a3-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Flow 'volume_create_manager' (b25977a3-51c7-4ec2-8460-8553d5cdd3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b4e38a-332d-4b61-8aa8-dbf6182f78bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b4e38a-332d-4b61-8aa8-dbf6182f78bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515390968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fcc00c-7b92-4335-a47b-21b326533998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dfe8836ed4134a5ef63a929789491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:41Z,use_quota=True,user_id='6437fae6b848433ca57ac5e58b04dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0790cd2f-3014-4f42-8463-294912129fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0790cd2f-3014-4f42-8463-294912129fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c83d597-bf54-472f-a4d6-d1109182d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c83d597-bf54-472f-a4d6-d1109182d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4fcc00c-7b92-4335-a47b-21b326533998', 'volume_name': 'volume-f4fcc00c-7b92-4335-a47b-21b326533998', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da28811b-110d-4e59-9b2d-de9ea21d5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da28811b-110d-4e59-9b2d-de9ea21d5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22af688-eac1-4d23-a537-5e357fc83486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Volume f4fcc00c-7b92-4335-a47b-21b326533998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4fcc00c-7b92-4335-a47b-21b326533998', 'volume_size': 1} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1515390968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fcc00c-7b92-4335-a47b-21b326533998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dfe8836ed4134a5ef63a929789491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:41Z,use_quota=True,user_id='6437fae6b848433ca57ac5e58b04dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Creating volume f4fcc00c-7b92-4335-a47b-21b326533998 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:40 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:40 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 1073741824 Sep 01 12:43:40 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:41 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 1073741824" returned: 0 in 0.655s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:41 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 Sep 01 12:43:41 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:41 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998" returned: 0 in 0.334s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22af688-eac1-4d23-a537-5e357fc83486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fcc00c-7b92-4335-a47b-21b326533998', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267614ac-2cdd-4c7e-b808-517192fd315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:41 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Volume volume-f4fcc00c-7b92-4335-a47b-21b326533998 (f4fcc00c-7b92-4335-a47b-21b326533998): created successfully Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267614ac-2cdd-4c7e-b808-517192fd315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Flow 'volume_create_manager' (b25977a3-51c7-4ec2-8460-8553d5cdd3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7963e7fb-8d70-48ec-b8af-60b00a9168f6 tempest-VolumesTransfersV357Test-969815735 None] Created volume successfully. Sep 01 12:43:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f1c0cea-c1b3-44fd-95fd-d14348bb7e34 tempest-VolumesTransfersV357Test-1438282126 None] Transfer volume completed successfully. Sep 01 12:43:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "cinder-f4fcc00c-7b92-4335-a47b-21b326533998-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-f4fcc00c-7b92-4335-a47b-21b326533998-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "cinder-quobyte-f4fcc00c-7b92-4335-a47b-21b326533998" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-quobyte-f4fcc00c-7b92-4335-a47b-21b326533998" acquired by "delete_volume" :: waited 0.049s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[397efb45-0d24-4f48-80ba-78ae07c551fa]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:46 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 Sep 01 12:43:46 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:46 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998" returned: 0 in 0.732s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:47 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998 Sep 01 12:43:47 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:47 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f4fcc00c-7b92-4335-a47b-21b326533998" returned: 0 in 0.734s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-quobyte-f4fcc00c-7b92-4335-a47b-21b326533998" released by "delete_volume" :: held 1.580s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Created reservations ['ea4e6b4c-ea65-40ba-ae2a-61184612dd02', '5436ac12-2259-4364-b4b9-d99a2773e7b3', '69062bf6-2fdb-424c-a347-16d5c6a2462f', '3ff28cbe-701b-4fb5-9681-7e3c4fe3c6b7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:47 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:47 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:48 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:48 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Deleted volume successfully. Sep 01 12:43:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4504b390-e83a-4138-a2c8-d1e365099775 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-f4fcc00c-7b92-4335-a47b-21b326533998-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Flow 'volume_create_manager' (7533d311-f234-486b-b13e-841f189fc80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a78014-3de1-4139-aa87-4b682b0d57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a78014-3de1-4139-aa87-4b682b0d57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1254624073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2f3ae0-1bac-4950-981c-f235ada83fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dfe8836ed4134a5ef63a929789491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:49Z,use_quota=True,user_id='6437fae6b848433ca57ac5e58b04dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de59ed06-03e5-46b2-a17d-8db21f7947b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de59ed06-03e5-46b2-a17d-8db21f7947b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604bb05d-754d-4559-b040-2298f1c8ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604bb05d-754d-4559-b040-2298f1c8ac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2f3ae0-1bac-4950-981c-f235ada83fb1', 'volume_name': 'volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc963baf-1d60-436a-912a-74f20d54ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc963baf-1d60-436a-912a-74f20d54ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0706fa-37bb-40db-815b-7c8a1cc9ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Volume 9a2f3ae0-1bac-4950-981c-f235ada83fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1', 'volume_size': 1} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1254624073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2f3ae0-1bac-4950-981c-f235ada83fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dfe8836ed4134a5ef63a929789491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:49Z,use_quota=True,user_id='6437fae6b848433ca57ac5e58b04dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Creating volume 9a2f3ae0-1bac-4950-981c-f235ada83fb1 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:49 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:49 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 1073741824 Sep 01 12:43:49 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Flow 'volume_create_manager' (b4e217a3-a906-47e6-ad0e-3a7dd568555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7d372-e523-45db-bcb5-c7ad9d9facc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b7d372-e523-45db-bcb5-c7ad9d9facc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-387572540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeaa0d7-2c9d-404b-ae6c-e311f60854e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26a0b351b5445e7993f136826708c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:50Z,use_quota=True,user_id='d080f0eb2f4b47989b9db5b7ed52def4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d78bf-61ac-48d0-bfe3-c341c404f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d78bf-61ac-48d0-bfe3-c341c404f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4d476a-52a3-444b-b13f-7803be221c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4d476a-52a3-444b-b13f-7803be221c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbeaa0d7-2c9d-404b-ae6c-e311f60854e9', 'volume_name': 'volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f7f4bd-e48f-452c-b41b-f62202364280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f7f4bd-e48f-452c-b41b-f62202364280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:49 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc359aa1-ad1d-4639-bbec-48f210296915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Volume cbeaa0d7-2c9d-404b-ae6c-e311f60854e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9', 'volume_size': 1} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 1073741824" returned: 0 in 0.566s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:50 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 Sep 01 12:43:50 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:50 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1" returned: 0 in 0.318s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-387572540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeaa0d7-2c9d-404b-ae6c-e311f60854e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26a0b351b5445e7993f136826708c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:43:50Z,use_quota=True,user_id='d080f0eb2f4b47989b9db5b7ed52def4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Creating volume cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:43:50 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0706fa-37bb-40db-815b-7c8a1cc9ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:50 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 1073741824 Sep 01 12:43:50 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89b0632-6a37-4ab7-860a-646a8819152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:50 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Volume volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 (9a2f3ae0-1bac-4950-981c-f235ada83fb1): created successfully Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89b0632-6a37-4ab7-860a-646a8819152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Flow 'volume_create_manager' (7533d311-f234-486b-b13e-841f189fc80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-64166071-12c3-4f73-905b-5604e9adb14b tempest-VolumesTransfersV357Test-969815735 None] Created volume successfully. Sep 01 12:43:50 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 1073741824" returned: 0 in 0.617s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:51 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:43:51 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:51 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.468s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc359aa1-ad1d-4639-bbec-48f210296915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc28c50-fc2a-49e8-96a0-e6f0873efe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:43:51 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Volume volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 (cbeaa0d7-2c9d-404b-ae6c-e311f60854e9): created successfully Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc28c50-fc2a-49e8-96a0-e6f0873efe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Flow 'volume_create_manager' (b4e217a3-a906-47e6-ad0e-3a7dd568555a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:43:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a72aac22-f7ab-43b9-87e9-db43cf7ce1f7 tempest-TestImageHashVerification-1588852636 None] Created volume successfully. Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "cinder-9a2f3ae0-1bac-4950-981c-f235ada83fb1-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-9a2f3ae0-1bac-4950-981c-f235ada83fb1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "cinder-quobyte-9a2f3ae0-1bac-4950-981c-f235ada83fb1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:43:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-quobyte-9a2f3ae0-1bac-4950-981c-f235ada83fb1" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:43:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a44da72-a070-4b20-9970-81c829072347]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:52 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 Sep 01 12:43:52 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:52 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1" returned: 0 in 0.587s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:52 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1 Sep 01 12:43:52 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:53 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9a2f3ae0-1bac-4950-981c-f235ada83fb1" returned: 0 in 0.439s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-quobyte-9a2f3ae0-1bac-4950-981c-f235ada83fb1" released by "delete_volume" :: held 1.102s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Created reservations ['036ab009-0d5f-48f3-a8ea-c619a0a431a9', '8b2afd42-7877-444b-95bc-f757a90f4cce', 'e7fdd8ef-0301-46fe-89ad-d51102860650', '4e650eed-d182-4441-b283-d2c32195be2f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:53 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:43:53 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca60bfa-c058-48f0-92b5-7f742e573f98]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:53 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:43:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Deleted volume successfully. Sep 01 12:43:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d250e9e-3731-4b11-bce1-a585ce468289 tempest-VolumesTransfersV357Test-722063662 None] Lock "cinder-9a2f3ae0-1bac-4950-981c-f235ada83fb1-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:43:53 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:43:53 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:54 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.496s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03af2eb-3405-4222-93c5-670044569b1f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:43:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:54 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:43:54 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:43:54 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 01 12:43:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.546s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:43:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 /opt/stack/data/cinder/conversion/cbeaa0d7-2c9d-404b-ae6c-e311f60854e9.temp_image.05109f0b-d8b7-49c9-a8a1-2cc74673be174maah38o.img {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:43:54 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 /opt/stack/data/cinder/conversion/cbeaa0d7-2c9d-404b-ae6c-e311f60854e9.temp_image.05109f0b-d8b7-49c9-a8a1-2cc74673be174maah38o.img Sep 01 12:43:54 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:01 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 /opt/stack/data/cinder/conversion/cbeaa0d7-2c9d-404b-ae6c-e311f60854e9.temp_image.05109f0b-d8b7-49c9-a8a1-2cc74673be174maah38o.img" returned: 0 in 6.424s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917d9f7-791c-41bc-8e06-bc3631145e35]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:01 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:44:01 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:01 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.694s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/conversion/cbeaa0d7-2c9d-404b-ae6c-e311f60854e9.temp_image.05109f0b-d8b7-49c9-a8a1-2cc74673be174maah38o.img {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:44:01 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Converted 1024.00 MB image at 159.33 MB/s Sep 01 12:44:01 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] 05109f0b-d8b7-49c9-a8a1-2cc74673be17 was raw, no need to convert to raw {{(pid=87008) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Flow 'volume_create_manager' (ff17f890-8c41-4aab-89f8-46ee25b5c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c83817-6e20-4a8c-b4d7-5477a00b869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c83817-6e20-4a8c-b4d7-5477a00b869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937011330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce61feb-2a33-4325-a767-148dd2c0d5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d393ea2f4458428f891f222e307ded81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:07Z,use_quota=True,user_id='a7cd504b86f94745ae761b9678cd4f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3848adf-a081-4880-96b7-6e38062c5daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3848adf-a081-4880-96b7-6e38062c5daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f24bdaf-6e38-4bf9-bf6a-3b9a31d2218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f24bdaf-6e38-4bf9-bf6a-3b9a31d2218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce61feb-2a33-4325-a767-148dd2c0d5a4', 'volume_name': 'volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2c4a90-4679-4b0e-98ff-3fa5d6bf0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2c4a90-4679-4b0e-98ff-3fa5d6bf0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51800c0c-29df-41ce-b979-20f680ce8271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4', 'volume_size': 1} Sep 01 12:44:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Flow 'volume_create_manager' (9bae2ab6-c29f-44f5-b1be-9fa587a63ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4c8eec-d126-47c2-9a09-c0e6e5016273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4c8eec-d126-47c2-9a09-c0e6e5016273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-529105600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a851882-f4a0-45d6-a0d9-e767c58506dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb34535e754c4ab8e87f3a165ca68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:08Z,use_quota=True,user_id='cec93b7a5bfe43d19c830499e1d6567a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad73f616-6e78-499c-acef-02b0c8e9c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad73f616-6e78-499c-acef-02b0c8e9c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c53ec62-9649-4c2f-920f-c19163a66402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c53ec62-9649-4c2f-920f-c19163a66402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a851882-f4a0-45d6-a0d9-e767c58506dd', 'volume_name': 'volume-7a851882-f4a0-45d6-a0d9-e767c58506dd', 'volume_size': 2}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df85474-318e-4c72-9564-a9099363e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df85474-318e-4c72-9564-a9099363e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47b5d90-e0ed-4b01-af4a-1980da2ecefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Volume 7a851882-f4a0-45d6-a0d9-e767c58506dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a851882-f4a0-45d6-a0d9-e767c58506dd', 'volume_size': 2} Sep 01 12:44:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (18dc7638-388f-4746-bfc9-f6328e031d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c23ed5e-b6f0-4542-8bd4-bb4e9ed47c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c23ed5e-b6f0-4542-8bd4-bb4e9ed47c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1761358515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e3670f-dd27-4225-a7f6-7b23b4e7c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:13Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff7e1f-0dd0-430a-9385-8aee757b1d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff7e1f-0dd0-430a-9385-8aee757b1d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f4cdb9-7b73-4ee6-bd65-f228d79b7a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f4cdb9-7b73-4ee6-bd65-f228d79b7a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e3670f-dd27-4225-a7f6-7b23b4e7c3f1', 'volume_name': 'volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c7d64c-7b0d-48af-8d8f-3f59decd9ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c7d64c-7b0d-48af-8d8f-3f59decd9ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675e64a7-582c-4152-8bf6-5b5a7eb8432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:12 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Volume 67e3670f-dd27-4225-a7f6-7b23b4e7c3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1', 'volume_size': 1} Sep 01 12:44:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=31,cinder:INSERT=16,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=43,cinder:UPDATE=52,cinder:INSERT=8,cinder:DELETE=6 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.288s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Uploaded volume to glance image-id: 05109f0b-d8b7-49c9-a8a1-2cc74673be17. {{(pid=87008) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.598s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937011330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce61feb-2a33-4325-a767-148dd2c0d5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d393ea2f4458428f891f222e307ded81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:07Z,use_quota=True,user_id='a7cd504b86f94745ae761b9678cd4f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Creating volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:22 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:22 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 1073741824 Sep 01 12:44:22 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1c23eb7c-a67c-4bef-a13f-f44a68210b34 tempest-TestImageHashVerification-1588852636 None] Copy volume to image completed successfully. Sep 01 12:44:23 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 1073741824" returned: 0 in 0.472s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:23 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:44:23 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Acquiring lock "cinder-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:23 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "cinder-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.471s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-529105600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a851882-f4a0-45d6-a0d9-e767c58506dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb34535e754c4ab8e87f3a165ca68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:08Z,use_quota=True,user_id='cec93b7a5bfe43d19c830499e1d6567a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Creating volume 7a851882-f4a0-45d6-a0d9-e767c58506dd {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:23 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd 2147483648 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:23 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd 2147483648 Sep 01 12:44:23 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51800c0c-29df-41ce-b979-20f680ce8271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511db56a-d75f-4173-8b43-a7584ffd07d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Volume volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 (9ce61feb-2a33-4325-a767-148dd2c0d5a4): created successfully Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511db56a-d75f-4173-8b43-a7584ffd07d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Flow 'volume_create_manager' (ff17f890-8c41-4aab-89f8-46ee25b5c36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Acquiring lock "cinder-quobyte-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b5d8184a-3ac4-4051-9fa1-2145ebf355e4 tempest-VolumesActionsTest-1148788667 None] Created volume successfully. Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "cinder-quobyte-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea4567-f573-4bc7-80a8-3af13ae785a4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:24 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:44:24 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:24 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd 2147483648" returned: 0 in 0.597s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:24 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:24 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9 Sep 01 12:44:24 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:24 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd Sep 01 12:44:24 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:24 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" returned: 0 in 0.278s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:24 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "cinder-quobyte-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9" released by "delete_volume" :: held 0.760s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.915s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1761358515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e3670f-dd27-4225-a7f6-7b23b4e7c3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:13Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Creating volume 67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:24 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 1073741824 Sep 01 12:44:24 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47b5d90-e0ed-4b01-af4a-1980da2ecefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a851882-f4a0-45d6-a0d9-e767c58506dd', 'volume_size': 2}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0f4a6d-d38a-4fce-81bc-f79ad4eb1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Volume volume-7a851882-f4a0-45d6-a0d9-e767c58506dd (7a851882-f4a0-45d6-a0d9-e767c58506dd): created successfully Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0f4a6d-d38a-4fce-81bc-f79ad4eb1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Flow 'volume_create_manager' (9bae2ab6-c29f-44f5-b1be-9fa587a63ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-872e1d81-774e-4d38-8019-a8401481e0b5 tempest-VolumesCloneNegativeTest-781821296 None] Created volume successfully. Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Created reservations ['26412d31-824d-41f8-b558-e2372de0d256', '26b7ac25-0629-48f5-8831-3015dee8658d', '63ab16d0-07c3-498d-9afb-4cbc266b57ea', 'cb31f319-d95a-4d7b-86b8-872658e8e71a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:24 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:44:24 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:25 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:44:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Deleted volume successfully. Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d59a443c-97f2-43fa-be92-56c28266cc1e tempest-TestImageHashVerification-1588852636 None] Lock "cinder-cbeaa0d7-2c9d-404b-ae6c-e311f60854e9-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:25 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 1073741824" returned: 0 in 0.627s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Acquiring lock "cinder-7a851882-f4a0-45d6-a0d9-e767c58506dd-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "cinder-7a851882-f4a0-45d6-a0d9-e767c58506dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:25 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 Sep 01 12:44:25 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Acquiring lock "cinder-quobyte-7a851882-f4a0-45d6-a0d9-e767c58506dd" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "cinder-quobyte-7a851882-f4a0-45d6-a0d9-e767c58506dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250810b-7699-4576-b5db-d6fd390653d3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:25 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd Sep 01 12:44:25 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:25 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675e64a7-582c-4152-8bf6-5b5a7eb8432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c3875-e77a-464a-8081-4885fc0dcc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:25 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Volume volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 (67e3670f-dd27-4225-a7f6-7b23b4e7c3f1): created successfully Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c3875-e77a-464a-8081-4885fc0dcc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (18dc7638-388f-4746-bfc9-f6328e031d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-520541db-94cc-45eb-b27f-7782f98e939e tempest-AttachVolumeNegativeTest-2061541993 None] Created volume successfully. Sep 01 12:44:25 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:25 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd Sep 01 12:44:25 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:26 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7a851882-f4a0-45d6-a0d9-e767c58506dd" returned: 0 in 0.292s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "cinder-quobyte-7a851882-f4a0-45d6-a0d9-e767c58506dd" released by "delete_volume" :: held 0.810s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Created reservations ['047b5d22-5b32-4bfe-a2a3-81d83cf3a0ca', '3ef6de04-e5d3-4657-9a8a-b9bc793e1339', '6fefa113-3c02-4ed6-a460-12d87e722a4d', 'b41b1b62-60c9-4556-ba62-c25cdf6b1d3c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:26 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:44:26 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:26 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:44:26 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:27 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.510s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:44:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Deleted volume successfully. Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-821b1348-20ca-4ea2-948a-f94948a41185 tempest-VolumesCloneNegativeTest-781821296 None] Lock "cinder-7a851882-f4a0-45d6-a0d9-e767c58506dd-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:27 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.519s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:44:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:44:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-3daf5db1-c939-4a97-ac36-2c6b1912a9f4 req-6a9f9cbe-8aba-45c7-9889-188b64e40470 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-3daf5db1-c939-4a97-ac36-2c6b1912a9f4 req-6a9f9cbe-8aba-45c7-9889-188b64e40470 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-3daf5db1-c939-4a97-ac36-2c6b1912a9f4 req-6a9f9cbe-8aba-45c7-9889-188b64e40470 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-3daf5db1-c939-4a97-ac36-2c6b1912a9f4 req-6a9f9cbe-8aba-45c7-9889-188b64e40470 tempest-AttachVolumeNegativeTest-2061541993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f46178c0-305b-4e45-a3cb-9404eae9d673', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:44:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-3daf5db1-c939-4a97-ac36-2c6b1912a9f4 req-6a9f9cbe-8aba-45c7-9889-188b64e40470 tempest-AttachVolumeNegativeTest-2061541993 None] attachment_update completed successfully. Sep 01 12:44:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-34c0107d-d3b9-4824-bf9f-54140650c93c req-854f5814-e7a5-4781-87b9-be5e22809355 tempest-AttachVolumeNegativeTest-2061541993 None] Terminate volume connection completed successfully. Sep 01 12:44:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-34c0107d-d3b9-4824-bf9f-54140650c93c req-854f5814-e7a5-4781-87b9-be5e22809355 tempest-AttachVolumeNegativeTest-2061541993 None] Deleting attachment f46178c0-305b-4e45-a3cb-9404eae9d673. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Flow 'volume_create_manager' (1d60a51c-7196-44e3-8359-e57bf61f00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15361e34-12c6-4db7-bba0-5cb1a597d97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15361e34-12c6-4db7-bba0-5cb1a597d97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2103181907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47af820b-8f8b-44d7-a2ad-c2e107647714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5e3320c3e44b29352b7f755d1e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:34Z,use_quota=True,user_id='4e82152c22194b1182dd25bd6e2f979c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a6038-e914-43e5-bd54-78dfe5721e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a6038-e914-43e5-bd54-78dfe5721e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72769e57-33f7-4a77-b6d3-b856deb4fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72769e57-33f7-4a77-b6d3-b856deb4fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47af820b-8f8b-44d7-a2ad-c2e107647714', 'volume_name': 'volume-47af820b-8f8b-44d7-a2ad-c2e107647714', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c17e507-8027-4467-9e2a-f057d297c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c17e507-8027-4467-9e2a-f057d297c65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb73a6e-3d57-4435-98d2-c0cb82cb2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Volume 47af820b-8f8b-44d7-a2ad-c2e107647714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47af820b-8f8b-44d7-a2ad-c2e107647714', 'volume_size': 1} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2103181907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47af820b-8f8b-44d7-a2ad-c2e107647714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5e3320c3e44b29352b7f755d1e92d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:34Z,use_quota=True,user_id='4e82152c22194b1182dd25bd6e2f979c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Creating volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:34 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 1073741824 Sep 01 12:44:34 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:35 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 1073741824" returned: 0 in 0.727s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:35 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 Sep 01 12:44:35 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:35 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb73a6e-3d57-4435-98d2-c0cb82cb2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47af820b-8f8b-44d7-a2ad-c2e107647714', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c0684-f678-45c5-b301-e2b2a194d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Volume volume-47af820b-8f8b-44d7-a2ad-c2e107647714 (47af820b-8f8b-44d7-a2ad-c2e107647714): created successfully Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c0684-f678-45c5-b301-e2b2a194d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Flow 'volume_create_manager' (1d60a51c-7196-44e3-8359-e57bf61f00a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6bdffc59-99ea-46d7-9b5e-07d0924261b8 tempest-VolumesSnapshotListTestJSON-1138247850 None] Created volume successfully. Sep 01 12:44:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-057d0cb4-26d5-416e-b01d-049590307494 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" by "attach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-057d0cb4-26d5-416e-b01d-049590307494 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" acquired by "attach_volume" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-057d0cb4-26d5-416e-b01d-049590307494 tempest-VolumesActionsTest-1148788667 None] Attaching volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4 to instance 58a504ea-2479-45e2-99c3-94831648a297 at mountpoint /dev/vdb on host None. Sep 01 12:44:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-057d0cb4-26d5-416e-b01d-049590307494 tempest-VolumesActionsTest-1148788667 None] Attach volume completed successfully. Sep 01 12:44:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-057d0cb4-26d5-416e-b01d-049590307494 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" released by "attach_volume" :: held 0.208s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee1861ee-5b6e-40a6-bf61-8056c4462c1f tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" by "detach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Creating offline snapshot 50303dee-fd2b-4cd8-8005-bf9923a659a0 of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee1861ee-5b6e-40a6-bf61-8056c4462c1f tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ee1861ee-5b6e-40a6-bf61-8056c4462c1f tempest-VolumesActionsTest-1148788667 None] Detaching volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4 from instance 58a504ea-2479-45e2-99c3-94831648a297. Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908e9a3-7d3e-4864-a5a8-eb98e5d26f5f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ee1861ee-5b6e-40a6-bf61-8056c4462c1f tempest-VolumesActionsTest-1148788667 None] Detach volume completed successfully. Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee1861ee-5b6e-40a6-bf61-8056c4462c1f tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" released by "detach_volume" :: held 0.165s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:37 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 Sep 01 12:44:37 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:37 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714" returned: 0 in 0.660s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:37 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 1G Sep 01 12:44:37 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:38 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 1G" returned: 0 in 0.704s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:38 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:44:38 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:38 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.339s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:38 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 is being set with open permissions: ugo+rw Sep 01 12:44:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:38 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:44:38 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:39 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:39 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info Sep 01 12:44:39 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:39 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info" returned: 0 in 0.399s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:39 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info is being set with open permissions: ugo+rw Sep 01 12:44:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:39 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info Sep 01 12:44:39 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:39 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.info" returned: 0 in 0.325s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b2db216a-c0f3-404c-9a68-318daa36e91d tempest-VolumesSnapshotListTestJSON-1138247850 None] Create snapshot completed successfully Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Creating offline snapshot 95cd02ef-a8eb-43df-a20f-f99091cffde0 of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff3143d-d4d8-4c1e-a595-21c3c71b2f41]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:41 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:44:41 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:41 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.746s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:41 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 1G Sep 01 12:44:41 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:42 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 1G" returned: 0 in 0.588s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:42 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:42 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:42 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:42 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 is being set with open permissions: ugo+rw Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:42 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:42 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:42 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-498f6362-e3ea-4a3f-81b1-2efd5baf84b7 tempest-VolumesSnapshotListTestJSON-1138247850 None] Create snapshot completed successfully Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Creating offline snapshot a8fc8585-d8b4-4798-87fc-c3133158cc4f of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3bf20-4ff6-4312-b357-ba4eff3340ac]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:44 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:44 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:44 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 0.600s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:44 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f 1G Sep 01 12:44:44 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:45 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f 1G" returned: 0 in 1.013s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:46 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f Sep 01 12:44:46 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (8cc185f2-238b-4054-b249-83bce62206f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e75201-a979-4f55-bb8f-efd18dc15cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e75201-a979-4f55-bb8f-efd18dc15cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581498526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024ca4a6-249e-4025-a6db-3e72610c9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:46Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5ee485-9d91-4b29-b092-0d43768bcf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5ee485-9d91-4b29-b092-0d43768bcf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f75e67-2505-48e9-94b4-db693ca555f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f75e67-2505-48e9-94b4-db693ca555f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024ca4a6-249e-4025-a6db-3e72610c9c59', 'volume_name': 'volume-024ca4a6-249e-4025-a6db-3e72610c9c59', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646f0f56-780d-4349-b471-bfc83e82eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646f0f56-780d-4349-b471-bfc83e82eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:46 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f8baca-a791-4a6c-9ead-ad3c0d97f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:46 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume 024ca4a6-249e-4025-a6db-3e72610c9c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024ca4a6-249e-4025-a6db-3e72610c9c59', 'volume_size': 1} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f" returned: 0 in 0.702s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f is being set with open permissions: ugo+rw Sep 01 12:44:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:46 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f Sep 01 12:44:46 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:47 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.809s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581498526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024ca4a6-249e-4025-a6db-3e72610c9c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:46Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume 024ca4a6-249e-4025-a6db-3e72610c9c59 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:47 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:47 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 1073741824 Sep 01 12:44:47 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-863c07dd-097f-4676-979e-45cb45223e26 tempest-VolumesSnapshotListTestJSON-1138247850 None] Create snapshot completed successfully Sep 01 12:44:47 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 1073741824" returned: 0 in 0.784s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:47 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 Sep 01 12:44:48 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:48 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f8baca-a791-4a6c-9ead-ad3c0d97f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024ca4a6-249e-4025-a6db-3e72610c9c59', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f05c7b1-ae98-44b2-a7cf-6780d804f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:48 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-024ca4a6-249e-4025-a6db-3e72610c9c59 (024ca4a6-249e-4025-a6db-3e72610c9c59): created successfully Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f05c7b1-ae98-44b2-a7cf-6780d804f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (8cc185f2-238b-4054-b249-83bce62206f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c4883323-44aa-4103-8c69-ac51bdb63cd6 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-a8fc8585-d8b4-4798-87fc-c3133158cc4f-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-a8fc8585-d8b4-4798-87fc-c3133158cc4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-a8fc8585-d8b4-4798-87fc-c3133158cc4f" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-a8fc8585-d8b4-4798-87fc-c3133158cc4f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Deleting offline snapshot a8fc8585-d8b4-4798-87fc-c3133158cc4f of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] snapshot_file for this snap is: volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660ee60-4367-4dcf-9f01-b143e848989a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:48 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f Sep 01 12:44:48 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:49 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f" returned: 0 in 0.717s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d81879d-acef-44af-92ce-7fb9ff4b1b66]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:49 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:49 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:50 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (2f1254e7-702c-4bac-b4ed-d74c284e9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025238c7-944a-4944-b4d6-8d8e76d46c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 1.123s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:50 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f Sep 01 12:44:50 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025238c7-944a-4944-b4d6-8d8e76d46c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696016739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60fbe7-213c-4c89-b25c-613991759865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:50Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240adabb-b52a-43d1-bc4b-0ee2192e5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240adabb-b52a-43d1-bc4b-0ee2192e5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de285e-ce85-44f2-873f-545c6a21f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de285e-ce85-44f2-873f-545c6a21f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c60fbe7-213c-4c89-b25c-613991759865', 'volume_name': 'volume-2c60fbe7-213c-4c89-b25c-613991759865', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a536e9c3-f1c1-4a23-bdf2-f460d63fe3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a536e9c3-f1c1-4a23-bdf2-f460d63fe3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe32ba8e-63f0-43f4-9b7d-b52caa5e969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:50 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume 2c60fbe7-213c-4c89-b25c-613991759865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c60fbe7-213c-4c89-b25c-613991759865', 'volume_size': 1} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1696016739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60fbe7-213c-4c89-b25c-613991759865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:50Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume 2c60fbe7-213c-4c89-b25c-613991759865 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:50 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:51 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 1073741824 Sep 01 12:44:51 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (3d211d93-e27c-4a80-a19b-2d512731056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079746bf-1122-4392-8723-bc04921658cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079746bf-1122-4392-8723-bc04921658cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337260003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109ba16-753b-4b61-bbbc-e33eda475a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:51Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b8666c-0a0b-46c2-accc-f8822c410714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b8666c-0a0b-46c2-accc-f8822c410714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da91328-42bd-4ced-92d1-39a5e835d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da91328-42bd-4ced-92d1-39a5e835d591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2109ba16-753b-4b61-bbbc-e33eda475a12', 'volume_name': 'volume-2109ba16-753b-4b61-bbbc-e33eda475a12', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:51 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25809b2-0f4d-48f9-93f2-96b2ac540ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25809b2-0f4d-48f9-93f2-96b2ac540ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696d9a1f-68ba-464e-aa04-91b806778ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:51 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume 2109ba16-753b-4b61-bbbc-e33eda475a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2109ba16-753b-4b61-bbbc-e33eda475a12', 'volume_size': 1} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f" returned: 0 in 0.944s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:51 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f Sep 01 12:44:51 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:52 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.a8fc8585-d8b4-4798-87fc-c3133158cc4f" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-a8fc8585-d8b4-4798-87fc-c3133158cc4f" released by "_delete_snapshot" :: held 3.335s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" released by "delete_snapshot" :: held 3.372s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:52 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Created reservations ['ce208d72-918d-4ae2-8914-b44c44fcec86', 'a68230ac-43da-4f63-9dbc-9337dd6cbe24', 'f8560b76-f3b6-4121-9b72-482f3645e169', '0b27d1c1-247b-47d9-8cc3-097ac09bbf71'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 1073741824" returned: 0 in 1.309s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:52 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 Sep 01 12:44:52 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (8a0a836c-6645-4eaf-b808-736ca4de78c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d034b1cb-6482-4da9-a542-d355a59fef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d034b1cb-6482-4da9-a542-d355a59fef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864589148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66da0931-712f-4524-87b9-aa41bcf38da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:52Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3db98-1cd8-48ee-9daf-ae11ef2aeb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3db98-1cd8-48ee-9daf-ae11ef2aeb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8219243e-6c57-49b2-b601-47693556fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8219243e-6c57-49b2-b601-47693556fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66da0931-712f-4524-87b9-aa41bcf38da1', 'volume_name': 'volume-66da0931-712f-4524-87b9-aa41bcf38da1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9d1c1-4dd4-4f7a-9f2c-303e45d4df79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9d1c1-4dd4-4f7a-9f2c-303e45d4df79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57545322-baac-4941-982e-997cd41d435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume 66da0931-712f-4524-87b9-aa41bcf38da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66da0931-712f-4524-87b9-aa41bcf38da1', 'volume_size': 1} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Delete snapshot completed successfully. Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37817257-9374-4d33-9d8d-b2606095fcbb tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-a8fc8585-d8b4-4798-87fc-c3133158cc4f-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:52 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865" returned: 0 in 0.544s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337260003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2109ba16-753b-4b61-bbbc-e33eda475a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:51Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume 2109ba16-753b-4b61-bbbc-e33eda475a12 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:52 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe32ba8e-63f0-43f4-9b7d-b52caa5e969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c60fbe7-213c-4c89-b25c-613991759865', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f59f5-7d2d-4081-86ef-cc0382c2028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-2c60fbe7-213c-4c89-b25c-613991759865 (2c60fbe7-213c-4c89-b25c-613991759865): created successfully Sep 01 12:44:53 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 1073741824 Sep 01 12:44:53 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f59f5-7d2d-4081-86ef-cc0382c2028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (2f1254e7-702c-4bac-b4ed-d74c284e9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-481bfc39-4fd6-4ac5-9e6a-b78cdb4d495c tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-95cd02ef-a8eb-43df-a20f-f99091cffde0-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-95cd02ef-a8eb-43df-a20f-f99091cffde0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-60354a41-be23-4992-b4d1-51a0575e2ec4 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" by "attach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" acquired by "delete_snapshot" :: waited 0.146s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-95cd02ef-a8eb-43df-a20f-f99091cffde0" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-60354a41-be23-4992-b4d1-51a0575e2ec4 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" acquired by "attach_volume" :: waited 0.134s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-95cd02ef-a8eb-43df-a20f-f99091cffde0" acquired by "_delete_snapshot" :: waited 0.164s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Deleting offline snapshot 95cd02ef-a8eb-43df-a20f-f99091cffde0 of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] snapshot_file for this snap is: volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3863471c-b63d-4c68-a37a-d2e62919286f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (5bfea48f-61d9-475c-b18c-6b506d06ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f65a9a7-c9d3-4a84-89d5-ee4aee55f669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f65a9a7-c9d3-4a84-89d5-ee4aee55f669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717687109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5699f3-35d4-476c-9c91-72c255614caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:54Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:54 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:54 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327cd53b-ee27-49ff-a22b-41bca58aac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:54 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327cd53b-ee27-49ff-a22b-41bca58aac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2341b71f-6b2b-4085-b8ad-a4f004e3ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2341b71f-6b2b-4085-b8ad-a4f004e3ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5699f3-35d4-476c-9c91-72c255614caf', 'volume_name': 'volume-ea5699f3-35d4-476c-9c91-72c255614caf', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecef149-36d2-4e81-b345-8d715a2fb87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecef149-36d2-4e81-b345-8d715a2fb87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96638c65-1a4a-4792-a485-2ed2092fe91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume ea5699f3-35d4-476c-9c91-72c255614caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5699f3-35d4-476c-9c91-72c255614caf', 'volume_size': 1} Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-60354a41-be23-4992-b4d1-51a0575e2ec4 tempest-VolumesActionsTest-1148788667 None] Attaching volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4 to instance 1c02c6b1-7b38-4166-aa1e-c2d4b2198327 at mountpoint /dev/vdb on host None. Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 1073741824" returned: 0 in 1.718s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-60354a41-be23-4992-b4d1-51a0575e2ec4 tempest-VolumesActionsTest-1148788667 None] Attach volume completed successfully. Sep 01 12:44:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-60354a41-be23-4992-b4d1-51a0575e2ec4 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4" released by "attach_volume" :: held 1.112s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:55 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 Sep 01 12:44:55 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:55 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 1.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (cf6f38de-4e00-413b-a7b8-4f36e52d60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b6281e-315c-4077-83ff-6d76f5c84142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4737146d-607e-4e97-9fa7-b62603d93e72]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b6281e-315c-4077-83ff-6d76f5c84142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442867433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14cce12-2f79-41b3-a469-d915254c973e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:55Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e373230-6cb9-4b84-b57c-fb3d04616acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e373230-6cb9-4b84-b57c-fb3d04616acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:55 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a80d2c-8564-4d2d-913e-f340e38a85ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a80d2c-8564-4d2d-913e-f340e38a85ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14cce12-2f79-41b3-a469-d915254c973e', 'volume_name': 'volume-f14cce12-2f79-41b3-a469-d915254c973e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fed937-bfc7-4b7f-a078-925344977b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2fed937-bfc7-4b7f-a078-925344977b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739d51d-77b4-4b9a-bb0b-b011bcdc81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume f14cce12-2f79-41b3-a469-d915254c973e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14cce12-2f79-41b3-a469-d915254c973e', 'volume_size': 1} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bb8cb27d-70f1-4d2e-9423-c4a597f79ace tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" by "detach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12" returned: 0 in 1.041s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (3055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.059s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864589148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66da0931-712f-4524-87b9-aa41bcf38da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:52Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume 66da0931-712f-4524-87b9-aa41bcf38da1 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:56 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:56 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:44:56 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bb8cb27d-70f1-4d2e-9423-c4a597f79ace tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" acquired by "detach_volume" :: waited 0.084s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bb8cb27d-70f1-4d2e-9423-c4a597f79ace tempest-VolumesActionsTest-1148788667 None] Detaching volume 9ce61feb-2a33-4325-a767-148dd2c0d5a4 from instance 1c02c6b1-7b38-4166-aa1e-c2d4b2198327. Sep 01 12:44:56 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 1073741824 Sep 01 12:44:56 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696d9a1f-68ba-464e-aa04-91b806778ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2109ba16-753b-4b61-bbbc-e33eda475a12', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1b34d-fb42-443f-a6b5-fa2f04c72605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-2109ba16-753b-4b61-bbbc-e33eda475a12 (2109ba16-753b-4b61-bbbc-e33eda475a12): created successfully Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa1b34d-fb42-443f-a6b5-fa2f04c72605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (3d211d93-e27c-4a80-a19b-2d512731056c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b4ae226f-490b-4333-a200-67f15baca655 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:44:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bb8cb27d-70f1-4d2e-9423-c4a597f79ace tempest-VolumesActionsTest-1148788667 None] Detach volume completed successfully. Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bb8cb27d-70f1-4d2e-9423-c4a597f79ace tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-detach_volume" released by "detach_volume" :: held 0.345s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:56 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 1.056s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:44:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:56 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:56 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:57 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 1073741824" returned: 0 in 1.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:57 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 Sep 01 12:44:57 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:57 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 1.011s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:57 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0 Sep 01 12:44:57 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:58 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1" returned: 0 in 0.630s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.464s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-717687109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5699f3-35d4-476c-9c91-72c255614caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:54Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume ea5699f3-35d4-476c-9c91-72c255614caf {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:58 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57545322-baac-4941-982e-997cd41d435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66da0931-712f-4524-87b9-aa41bcf38da1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ca2caf-f1fc-4a25-b854-553c9cfc57db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:58 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf 1073741824 Sep 01 12:44:58 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-66da0931-712f-4524-87b9-aa41bcf38da1 (66da0931-712f-4524-87b9-aa41bcf38da1): created successfully Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ca2caf-f1fc-4a25-b854-553c9cfc57db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (8a0a836c-6645-4eaf-b808-736ca4de78c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:58 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1b4e39d5-8500-4786-bb9a-cc02425b4f1d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:44:58 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.95cd02ef-a8eb-43df-a20f-f99091cffde0" returned: 0 in 0.678s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-95cd02ef-a8eb-43df-a20f-f99091cffde0" released by "_delete_snapshot" :: held 4.497s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" released by "delete_snapshot" :: held 4.680s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Created reservations ['1a8f798d-ef6e-422a-80f6-c92db5cccc80', '3105784b-c04b-4475-bf79-10585f434ac3', '280f5b18-9ae5-42f4-bc82-3f31ff6c8469', '0009f594-6b57-4285-9324-c16f31c7b5fe'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:44:58 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Delete snapshot completed successfully. Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f347c407-946d-4d2c-a908-1323ce6cb93c tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-95cd02ef-a8eb-43df-a20f-f99091cffde0-delete_snapshot" released by "delete_snapshot" :: held 5.068s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:44:58 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf 1073741824" returned: 0 in 0.805s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:59 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf Sep 01 12:44:59 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-50303dee-fd2b-4cd8-8005-bf9923a659a0-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-50303dee-fd2b-4cd8-8005-bf9923a659a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-50303dee-fd2b-4cd8-8005-bf9923a659a0" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-50303dee-fd2b-4cd8-8005-bf9923a659a0" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Deleting offline snapshot 50303dee-fd2b-4cd8-8005-bf9923a659a0 of volume 47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] snapshot_file for this snap is: volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4d27b6-6e9b-4562-9d93-cdf38b108567]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:59 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf" returned: 0 in 0.698s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:59 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.774s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442867433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14cce12-2f79-41b3-a469-d915254c973e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d23345a2dc4505a29030f0ac2d46cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:44:55Z,use_quota=True,user_id='cc54cb5efa8541209c4b9ef9a482e2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Creating volume f14cce12-2f79-41b3-a469-d915254c973e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:44:59 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:44:59 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96638c65-1a4a-4792-a485-2ed2092fe91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5699f3-35d4-476c-9c91-72c255614caf', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:59 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e 1073741824 Sep 01 12:44:59 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a1cdd8-7244-4d21-96cd-ca8559ec43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:44:59 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-ea5699f3-35d4-476c-9c91-72c255614caf (ea5699f3-35d4-476c-9c91-72c255614caf): created successfully Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a1cdd8-7244-4d21-96cd-ca8559ec43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:44:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (5bfea48f-61d9-475c-b18c-6b506d06ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:44:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f8c678d6-eddf-4cfd-abba-6aae8ce7b4b3 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:45:00 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.590s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47af820b-8f8b-44d7-a2ad-c2e107647714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[81339616-05a0-4c73-9189-c98529c4472c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:00 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 Sep 01 12:45:00 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:00 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e 1073741824" returned: 0 in 0.810s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:00 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e Sep 01 12:45:00 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:01 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714" returned: 0 in 0.885s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:01 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e" returned: 0 in 0.502s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:01 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:45:01 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739d51d-77b4-4b9a-bb0b-b011bcdc81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14cce12-2f79-41b3-a469-d915254c973e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ca52b-945b-4824-9df8-4c4ba4189c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Volume volume-f14cce12-2f79-41b3-a469-d915254c973e (f14cce12-2f79-41b3-a469-d915254c973e): created successfully Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ca52b-945b-4824-9df8-4c4ba4189c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Flow 'volume_create_manager' (cf6f38de-4e00-413b-a7b8-4f36e52d60ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-62013d9d-cacd-4b9a-8402-b91bd25c56c1 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created volume successfully. Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-f14cce12-2f79-41b3-a469-d915254c973e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:01 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.652s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-f14cce12-2f79-41b3-a469-d915254c973e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:01 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0 Sep 01 12:45:01 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-f14cce12-2f79-41b3-a469-d915254c973e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-f14cce12-2f79-41b3-a469-d915254c973e" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[720dfa36-4b0e-4ee2-9b8c-84ccc374a2d2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:02 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e Sep 01 12:45:02 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:02 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714.50303dee-fd2b-4cd8-8005-bf9923a659a0" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-50303dee-fd2b-4cd8-8005-bf9923a659a0" released by "_delete_snapshot" :: held 2.740s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" released by "delete_snapshot" :: held 2.838s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:02 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e" returned: 0 in 0.418s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Created reservations ['c03fe329-e3c5-4544-ae09-2e4815ba39b5', '6b85eb6f-463b-4fda-9ba3-bddbd30cbb6d', 'f9177ce2-cc69-4627-bc11-944e82b19e1a', 'e8974139-f2bf-4f3a-9d87-be2a4bb3253d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:02 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e Sep 01 12:45:02 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Delete snapshot completed successfully. Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4f3829ac-6eca-4217-a953-7474cc956440 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-50303dee-fd2b-4cd8-8005-bf9923a659a0-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-47af820b-8f8b-44d7-a2ad-c2e107647714-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-47af820b-8f8b-44d7-a2ad-c2e107647714-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" acquired by "delete_volume" :: waited 0.040s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:02 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f14cce12-2f79-41b3-a469-d915254c973e" returned: 0 in 0.562s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-f14cce12-2f79-41b3-a469-d915254c973e" released by "delete_volume" :: held 1.044s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be508cb-5014-40e6-9cdc-ea2a3b930ef6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['66410e0e-7d11-479b-b73b-9462f8e3e1b1', 'ed72aedf-6c21-404d-8116-6bf11b406ba7', '36dcb38b-d746-4193-ae2f-41a3bdb8bca3', 'ae74aaba-5735-4254-94bc-5c1d890fbfc3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3936c9-554c-4af8-8996-6550d70ba016]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:03 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:03 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:03 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:03 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:03 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:03 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:03 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714" returned: 0 in 0.698s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:03 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.460s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:03 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714 Sep 01 12:45:03 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-72c89030-a26d-43fe-993e-49004e3e019d tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-f14cce12-2f79-41b3-a469-d915254c973e-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:03 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.649s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc8733f-0d05-4445-bab2-86beb59820ea]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:03 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:03 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:03 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-47af820b-8f8b-44d7-a2ad-c2e107647714" returned: 0 in 0.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-quobyte-47af820b-8f8b-44d7-a2ad-c2e107647714" released by "delete_volume" :: held 1.146s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Created reservations ['d44feb4e-1cb6-4a49-8968-00fdc5b24b15', '212a58ae-3171-4636-b1d2-c015a6b012f7', '2b5166b3-7e6b-43a4-b6ea-217a38b18370', '81aa31a3-0bd4-4c99-8dff-4aa1028b51c4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-ea5699f3-35d4-476c-9c91-72c255614caf-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-ea5699f3-35d4-476c-9c91-72c255614caf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:04 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.470s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.e945432a-fa9e-4ef4-bd5d-825a3b3a6c94q5b1uakc.img {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:04 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:04 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:04 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.e945432a-fa9e-4ef4-bd5d-825a3b3a6c94q5b1uakc.img Sep 01 12:45:04 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-ea5699f3-35d4-476c-9c91-72c255614caf" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-ea5699f3-35d4-476c-9c91-72c255614caf" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a54dec-dcad-4653-842d-4e282cd249c3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:04 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:04 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf Sep 01 12:45:04 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Deleted volume successfully. Sep 01 12:45:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b4924c66-0200-46cd-a0c3-0d638f9b8ba2 tempest-VolumesSnapshotListTestJSON-1138247850 None] Lock "cinder-47af820b-8f8b-44d7-a2ad-c2e107647714-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:05 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf" returned: 0 in 1.044s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:05 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf Sep 01 12:45:05 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:06 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ea5699f3-35d4-476c-9c91-72c255614caf" returned: 0 in 0.966s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-ea5699f3-35d4-476c-9c91-72c255614caf" released by "delete_volume" :: held 2.114s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:06 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['1345b04d-ece1-483d-b5a5-1b70b31bb22d', 'a86621fb-50c2-40b0-a632-35673b8bfb9e', 'f3dfd6e4-1f30-4074-920a-991331417549', 'f2195b31-9750-4651-97c8-5b350322f471'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:07 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:07 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:07 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.933s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-323037e4-8199-4f97-a8ac-da766e72d799 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-ea5699f3-35d4-476c-9c91-72c255614caf-delete_volume" released by "delete_volume" :: held 3.895s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-66da0931-712f-4524-87b9-aa41bcf38da1-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-66da0931-712f-4524-87b9-aa41bcf38da1-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-66da0931-712f-4524-87b9-aa41bcf38da1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-66da0931-712f-4524-87b9-aa41bcf38da1" acquired by "delete_volume" :: waited 0.045s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda1ece-c2b5-4b80-84bf-2ae854b693a5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:08 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 Sep 01 12:45:08 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:09 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1" returned: 0 in 0.749s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:09 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1 Sep 01 12:45:09 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:10 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-66da0931-712f-4524-87b9-aa41bcf38da1" returned: 0 in 1.082s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-66da0931-712f-4524-87b9-aa41bcf38da1" released by "delete_volume" :: held 1.993s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['baf7f193-46d2-4b46-a2a0-d3ce92b76650', '4c98ef97-ba49-48dd-b957-00f7cc12cce1', 'f3cbc7e3-b5ce-4e96-9198-49b8d017202c', 'e6c60dc2-cb9a-407e-9e22-affb7da47365'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:11 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:11 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:11 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.e945432a-fa9e-4ef4-bd5d-825a3b3a6c94q5b1uakc.img" returned: 0 in 7.018s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d673d47-51e7-40a2-93a1-b2140e557488]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:11 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.426s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e68eb8a9-b040-4378-899a-2a69b3b66e86 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-66da0931-712f-4524-87b9-aa41bcf38da1-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:11 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:11 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:11 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.649s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.e945432a-fa9e-4ef4-bd5d-825a3b3a6c94q5b1uakc.img {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:45:11 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Converted 1024.00 MB image at 145.87 MB/s Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] e945432a-fa9e-4ef4-bd5d-825a3b3a6c94 was raw, no need to convert to raw {{(pid=87008) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 12:45:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-2109ba16-753b-4b61-bbbc-e33eda475a12-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-2109ba16-753b-4b61-bbbc-e33eda475a12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-2109ba16-753b-4b61-bbbc-e33eda475a12" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-2109ba16-753b-4b61-bbbc-e33eda475a12" acquired by "delete_volume" :: waited 0.033s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a33d6-884f-4b6e-840c-3e5faea5cccd]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:12 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 Sep 01 12:45:12 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:12 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12" returned: 0 in 0.411s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:12 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12 Sep 01 12:45:12 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:12 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2109ba16-753b-4b61-bbbc-e33eda475a12" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-2109ba16-753b-4b61-bbbc-e33eda475a12" released by "delete_volume" :: held 0.739s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:12 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['14e75000-d33a-4d01-9b0f-5495217ea3dd', '1ffbfd10-9aba-42f8-bc5f-9a62de3d69c0', 'fdd2dd86-6a27-4916-9935-90032dceaf1b', '210b155a-ccad-4308-8954-89a6e5835ba6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:13 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:13 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-2c60fbe7-213c-4c89-b25c-613991759865-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-2c60fbe7-213c-4c89-b25c-613991759865-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-2c60fbe7-213c-4c89-b25c-613991759865" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-2c60fbe7-213c-4c89-b25c-613991759865" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:13 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9e9ab0-9239-46ee-b0f9-9a9d04a78451]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Flow 'volume_create_manager' (823acb6f-eaf3-43f1-97d8-8900fbb389a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0b88a0-8469-4faf-8a38-d3e74e7ca59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-222aba2f-11fb-4956-8d2d-e202d282ebba tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-2109ba16-753b-4b61-bbbc-e33eda475a12-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:13 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 Sep 01 12:45:13 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0b88a0-8469-4faf-8a38-d3e74e7ca59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1602227292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd2c5d658264ab594fc49eb4cbb1fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:13Z,use_quota=True,user_id='2fa945268b5a4cbab060248eb8df3cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477465e-4c26-4e73-af86-d2f7feec12e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3477465e-4c26-4e73-af86-d2f7feec12e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654dc50-82f0-40cd-8418-741af52b389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654dc50-82f0-40cd-8418-741af52b389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64', 'volume_name': 'volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64', 'volume_size': 2}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e4c48-e5ea-4f9a-8197-8ea7a93675e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e4c48-e5ea-4f9a-8197-8ea7a93675e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5947befb-e2af-4198-bef9-72a88fc06028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:13 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Volume dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64', 'volume_size': 2} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:13 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865" returned: 0 in 0.397s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:13 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865 Sep 01 12:45:13 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:14 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2c60fbe7-213c-4c89-b25c-613991759865" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-2c60fbe7-213c-4c89-b25c-613991759865" released by "delete_volume" :: held 0.737s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['97640533-8fd6-4f51-8c15-ab3e899f825c', 'd09ac0d4-c9f2-4918-bc22-73abb44a3f7c', '5821ba20-e835-4502-8480-d28462f7e926', 'a2f0de26-357b-4342-bea3-3d0dce87c86a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:14 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:14 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-024ca4a6-249e-4025-a6db-3e72610c9c59-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-024ca4a6-249e-4025-a6db-3e72610c9c59-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "cinder-quobyte-024ca4a6-249e-4025-a6db-3e72610c9c59" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:14 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.361s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-024ca4a6-249e-4025-a6db-3e72610c9c59" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[46699c66-ef86-4737-a176-b9639e8892f3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-27d2f2df-3234-44b8-92e7-e0750381db34 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-2c60fbe7-213c-4c89-b25c-613991759865-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:14 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 Sep 01 12:45:14 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:14 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:15 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59 Sep 01 12:45:15 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:15 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-024ca4a6-249e-4025-a6db-3e72610c9c59" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-quobyte-024ca4a6-249e-4025-a6db-3e72610c9c59" released by "delete_volume" :: held 0.738s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Created reservations ['553f79c4-b793-4d27-b899-70e6992f490a', '87dba419-ac49-4d14-9b3e-230e99879974', '9c00e0c3-b2ec-4489-a8ba-43e9a13f981d', '2bbfa8ab-6267-4f27-ab71-040a50f3e542'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:15 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:15 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:15 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:15 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Deleted volume successfully. Sep 01 12:45:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-51160329-21d9-469d-9431-6253142e6611 tempest-CreateVolumesFromSourceVolumeTest-207419566 None] Lock "cinder-024ca4a6-249e-4025-a6db-3e72610c9c59-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (7f8a2019-b055-492b-9570-544bb3106448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d156dc-6ee8-4974-a734-9d01b55748f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d156dc-6ee8-4974-a734-9d01b55748f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1588185327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef43b5-b047-4ce6-9c8f-66ffd58f3262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:22Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e23eb0-37d7-4ba5-ac05-8aead768eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e23eb0-37d7-4ba5-ac05-8aead768eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2953def7-6cb8-4e63-a863-ca80957c196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2953def7-6cb8-4e63-a863-ca80957c196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ef43b5-b047-4ce6-9c8f-66ffd58f3262', 'volume_name': 'volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf95931-3265-4fef-8494-816551bb8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf95931-3265-4fef-8494-816551bb8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f2d338-a55a-4618-9818-d78fc7cea808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Volume 93ef43b5-b047-4ce6-9c8f-66ffd58f3262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262', 'volume_size': 1} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Flow 'volume_create_manager' (79a4b380-361f-4113-ab71-40ff9e8a61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2332e2-565f-4fb9-98cb-675ccffa7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2332e2-565f-4fb9-98cb-675ccffa7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c434d38c-e9c8-41ef-bdfb-474c3fdb3951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59292e3fdc4e427ea8c9b48984cb0cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:22Z,use_quota=True,user_id='425f685cc7204187b05e17cf5070479b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8056b6-3e10-4e34-b522-5be908da377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8056b6-3e10-4e34-b522-5be908da377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bb052d-1e39-47c9-8139-ea5fb86add61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bb052d-1e39-47c9-8139-ea5fb86add61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c434d38c-e9c8-41ef-bdfb-474c3fdb3951', 'volume_name': 'volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951', 'volume_size': 1, 'image_id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bb05e72fe3a8a312e7b4d05145e6d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59292e3fdc4e427ea8c9b48984cb0cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e4a9fcffbc7ff3b318809e8c5dac81c06154a1b627eca1f17345cfcea1369c7be6b549d44fe5e43f8cf370806adecfb1fef911b41ac0faf5205fcb8fde2cb29', 'id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'created_at': datetime.datetime(2026, 9, 1, 10, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193fb19-d79f-470f-a8bd-f49710eae477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193fb19-d79f-470f-a8bd-f49710eae477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706100b6-dc02-4476-83a3-d77e4c8e2aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951', 'volume_size': 1, 'image_id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bb05e72fe3a8a312e7b4d05145e6d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59292e3fdc4e427ea8c9b48984cb0cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e4a9fcffbc7ff3b318809e8c5dac81c06154a1b627eca1f17345cfcea1369c7be6b549d44fe5e43f8cf370806adecfb1fef911b41ac0faf5205fcb8fde2cb29', 'id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'created_at': datetime.datetime(2026, 9, 1, 10, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35/file', 'properties': {}}, 'image_service': } Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Trying to clone c434d38c-e9c8-41ef-bdfb-474c3fdb3951 from image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:45:22 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce23256-1e85-4210-b59d-68870a3c0fab]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:23 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:23 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:23 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:23 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:23 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:23 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Temporary image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 is fetched for user 425f685cc7204187b05e17cf5070479b. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=112,cinder:UPDATE=136,cinder:INSERT=27,cinder:DELETE=12 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=111,cinder:UPDATE=124,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e3b8c3-4e5a-40e4-a769-18b9febc2eeb]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:23 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:23 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:24 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:24 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:24 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:24 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:45:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:26 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:26 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:26 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:45:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.232s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Uploaded volume to glance image-id: e945432a-fa9e-4ef4-bd5d-825a3b3a6c94. {{(pid=87008) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.755s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1602227292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd2c5d658264ab594fc49eb4cbb1fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:13Z,use_quota=True,user_id='2fa945268b5a4cbab060248eb8df3cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Creating volume dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:33 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 2147483648 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:33 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 2147483648 Sep 01 12:45:33 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-06592501-7795-4364-9bff-e6ed8f9d5fae tempest-VolumesActionsTest-1148788667 None] Copy volume to image completed successfully. Sep 01 12:45:33 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 2147483648" returned: 0 in 0.540s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:33 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 Sep 01 12:45:33 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:34 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.109s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1588185327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef43b5-b047-4ce6-9c8f-66ffd58f3262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f6e88be0b44ec8908d51acb4454ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:22Z,use_quota=True,user_id='22aae6d5cc184ecc956743bcc08ed432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Creating volume 93ef43b5-b047-4ce6-9c8f-66ffd58f3262 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5947befb-e2af-4198-bef9-72a88fc06028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64', 'volume_size': 2}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f66e4ea-4457-4b61-b055-c7870b3c6264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:34 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 1073741824 Sep 01 12:45:34 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Volume volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 (dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64): created successfully Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f66e4ea-4457-4b61-b055-c7870b3c6264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Flow 'volume_create_manager' (823acb6f-eaf3-43f1-97d8-8900fbb389a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-83eda313-bd2b-406d-bd68-30cf0a4a18a4 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Created volume successfully. Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:34 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 1073741824" returned: 0 in 0.447s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:34 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 Sep 01 12:45:34 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:34 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.497s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c434d38c-e9c8-41ef-bdfb-474c3fdb3951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59292e3fdc4e427ea8c9b48984cb0cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:22Z,use_quota=True,user_id='425f685cc7204187b05e17cf5070479b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Creating volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f2d338-a55a-4618-9818-d78fc7cea808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41f104b-7a39-4963-a9d9-90929fa11aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:34 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1073741824 Sep 01 12:45:34 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Volume volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 (93ef43b5-b047-4ce6-9c8f-66ffd58f3262): created successfully Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41f104b-7a39-4963-a9d9-90929fa11aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Flow 'volume_create_manager' (7f8a2019-b055-492b-9570-544bb3106448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-17e13cb5-0996-45ef-a7da-9b618b871580 tempest-AttachVolumeNegativeTest-2061541993 None] Created volume successfully. Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:35 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1073741824" returned: 0 in 0.451s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:35 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 Sep 01 12:45:35 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:35 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" returned: 0 in 0.257s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.205s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d9501-69d9-4460-b9bf-fbcfb81a8300]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Attempting download of cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}])) to volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c2260-ef7f-4865-89ab-8e3d8bdeed10]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:35 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:35 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:35 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d Sep 01 12:45:35 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:36 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f203d-995b-4dbe-90a3-47d377aea7ff]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:36 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d" returned: 0 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:36 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:36 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:36 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d Sep 01 12:45:36 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9b65cb72-8fc0-415d-9ea9-49c69abe1d30 req-3e572c15-06cf-4e2f-be87-fccee25db0fc tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:36 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d" returned: 1 in 0.369s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_hqml4e7d' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f3cea-a31e-47d9-a1e0-eb583e4e4ac8]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:36 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.426s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:36 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img Sep 01 12:45:36 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:36 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:36 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:36 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:37 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD Sep 01 12:45:37 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:37 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:45:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 was raw, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:45:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:37 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 Sep 01 12:45:37 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:38 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" returned: 0 in 1.134s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:38 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35_mfxu4eirdevstack@QuobyteHD, size 0.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:45:38 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:45:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:38 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1G Sep 01 12:45:38 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:39 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 1G" returned: 0 in 0.632s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Downloaded image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}])) to volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Temporary image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 for user 425f685cc7204187b05e17cf5070479b is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Marking volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Copying metadata from image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 to c434d38c-e9c8-41ef-bdfb-474c3fdb3951. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Creating volume glance metadata for volume c434d38c-e9c8-41ef-bdfb-474c3fdb3951 backed by image cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35 with: {'image_id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bb05e72fe3a8a312e7b4d05145e6d0b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706100b6-dc02-4476-83a3-d77e4c8e2aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951', 'volume_size': 1, 'image_id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bb05e72fe3a8a312e7b4d05145e6d0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59292e3fdc4e427ea8c9b48984cb0cd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e4a9fcffbc7ff3b318809e8c5dac81c06154a1b627eca1f17345cfcea1369c7be6b549d44fe5e43f8cf370806adecfb1fef911b41ac0faf5205fcb8fde2cb29', 'id': 'cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35', 'created_at': datetime.datetime(2026, 9, 1, 10, 45, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfdf0ccc-e5f0-4573-ba1a-ac38d3b79e35/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fb5ddd-e4a6-4181-b03c-cd4ae1d4fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Volume volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 (c434d38c-e9c8-41ef-bdfb-474c3fdb3951): created successfully Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fb5ddd-e4a6-4181-b03c-cd4ae1d4fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Flow 'volume_create_manager' (79a4b380-361f-4113-ab71-40ff9e8a61da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9a65d158-064b-4701-b225-10eb13ef65e4 tempest-VolumeImageDependencyTests-1649107316 None] Created volume successfully. Sep 01 12:45:41 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img" returned: 0 in 4.596s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b4664-61f0-4ac2-a67d-95b00825f7b7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Acquiring lock "cinder-c434d38c-e9c8-41ef-bdfb-474c3fdb3951-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "cinder-c434d38c-e9c8-41ef-bdfb-474c3fdb3951-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Acquiring lock "cinder-quobyte-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "cinder-quobyte-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:41 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:41 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3c509-292c-45ef-b121-09e19ae322a8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:41 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 Sep 01 12:45:41 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:41 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:41 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951 Sep 01 12:45:41 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:41 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.568s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:45:41 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Converted 1024.00 MB image at 222.76 MB/s Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] cf37f725-a634-4fa5-80d6-38ab6c10fbe3 was raw, converting to qcow2 {{(pid=87008) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2028779-44b5-4151-a7cb-7c34a943c306]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:41 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img Sep 01 12:45:41 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:41 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "cinder-quobyte-c434d38c-e9c8-41ef-bdfb-474c3fdb3951" released by "delete_volume" :: held 0.686s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Created reservations ['b637dc3f-c0b4-40e8-86d1-bd06ff0e8166', '86c7171a-e758-48b0-bd9e-65be29e9fa93', 'a94a2d7a-9416-4660-b7c9-4b0776b8dbe6', '39499415-479d-4fd3-9dde-1860152f6651'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:42 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:42 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:42 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img" returned: 0 in 0.391s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:42 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img Sep 01 12:45:42 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:42 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.328s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Deleted volume successfully. Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d51e4d1-64bd-4fe4-91ca-c2926f69043a tempest-VolumeImageDependencyTests-1649107316 None] Lock "cinder-c434d38c-e9c8-41ef-bdfb-474c3fdb3951-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:42 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img" returned: 1 in 0.463s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:42 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd Sep 01 12:45:42 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:42 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Image conversion details: src /opt/stack/data/cinder/conversion/9ce61feb-2a33-4325-a767-148dd2c0d5a4.temp_image.cf37f725-a634-4fa5-80d6-38ab6c10fbe32_8qjbrg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:45:42 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9982de33-a4ad-4ad0-afc9-c5b14ff410b7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:43 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd Sep 01 12:45:43 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:43 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6ur2lpgd" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.139s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Uploaded volume to glance image-id: cf37f725-a634-4fa5-80d6-38ab6c10fbe3. {{(pid=87008) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.733s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Creating offline snapshot 62645d8a-1f9f-4cb6-8957-0c50b134768b of volume dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:45:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fdc07f58-6a4d-418e-9082-be20042bbfcd tempest-VolumesActionsTest-1148788667 None] Copy volume to image completed successfully. Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[52743284-000d-46d2-98ba-ccac8dd81d5b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:45 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 Sep 01 12:45:45 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:45 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b 2G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:45 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b 2G Sep 01 12:45:45 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Flow 'volume_create_manager' (a637f869-adad-40d8-b0e2-23cd8c7eaebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28f6261-f0b2-41d3-bd76-cf24f1885ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28f6261-f0b2-41d3-bd76-cf24f1885ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce5d141-1033-49d0-8faf-aaa7af4e29d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b64844198b4509b98a93935512c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:46Z,use_quota=True,user_id='6b3e4725a0294607a2d7ee04ede3fff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e611d2-0ae4-42fa-bb3f-5656303544c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e611d2-0ae4-42fa-bb3f-5656303544c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d47481-471f-4d2c-9a56-c1a03ebe28ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:45 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d47481-471f-4d2c-9a56-c1a03ebe28ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce5d141-1033-49d0-8faf-aaa7af4e29d0', 'volume_name': 'volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58173dc6-6e4d-448a-8d59-33635ef0afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58173dc6-6e4d-448a-8d59-33635ef0afa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725471f2-9db0-4705-98f6-865cc29d69a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:45 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Volume 3ce5d141-1033-49d0-8faf-aaa7af4e29d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0', 'volume_size': 1} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b 2G" returned: 0 in 0.532s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:45 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b Sep 01 12:45:45 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b is being set with open permissions: ugo+rw Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:46 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b Sep 01 12:45:46 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "cinder-quobyte-9ce61feb-2a33-4325-a767-148dd2c0d5a4" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-quobyte-9ce61feb-2a33-4325-a767-148dd2c0d5a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c49a33-8f86-4574-a23a-d6c5f5849c6e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:46 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:46 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:46 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info Sep 01 12:45:46 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info is being set with open permissions: ugo+rw Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:46 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info Sep 01 12:45:46 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:46 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4 Sep 01 12:45:46 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:46 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.info" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9b65cb72-8fc0-415d-9ea9-49c69abe1d30 req-3e572c15-06cf-4e2f-be87-fccee25db0fc tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.520s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:47 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9ce61feb-2a33-4325-a767-148dd2c0d5a4" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-9b65cb72-8fc0-415d-9ea9-49c69abe1d30 req-3e572c15-06cf-4e2f-be87-fccee25db0fc tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce5d141-1033-49d0-8faf-aaa7af4e29d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b64844198b4509b98a93935512c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:46Z,use_quota=True,user_id='6b3e4725a0294607a2d7ee04ede3fff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Creating volume 3ce5d141-1033-49d0-8faf-aaa7af4e29d0 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:47 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-quobyte-9ce61feb-2a33-4325-a767-148dd2c0d5a4" released by "delete_volume" :: held 0.749s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:47 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 1073741824 Sep 01 12:45:47 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-94cb88a9-0885-4aa9-aca0-1da09ba03bbf tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Create snapshot completed successfully Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-9b65cb72-8fc0-415d-9ea9-49c69abe1d30 req-3e572c15-06cf-4e2f-be87-fccee25db0fc tempest-AttachVolumeNegativeTest-2061541993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86cc4ffd-5cca-4862-8b97-5089bc001ef9', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Created reservations ['a3a40c1d-576e-4c12-a1ab-818fe1d89150', '9ae6d4c6-bba8-4295-86ef-47192f15eb85', 'e2b3cfcc-1fcc-42fa-a75f-1b64929d8674', '9f181ebe-9f87-4514-9c96-1f4ab8cd658e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-9b65cb72-8fc0-415d-9ea9-49c69abe1d30 req-3e572c15-06cf-4e2f-be87-fccee25db0fc tempest-AttachVolumeNegativeTest-2061541993 None] attachment_update completed successfully. Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:47 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:47 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:47 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.310s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Deleted volume successfully. Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d00c6a33-e5dd-40e2-98ec-ee52610e3d50 tempest-VolumesActionsTest-1148788667 None] Lock "cinder-9ce61feb-2a33-4325-a767-148dd2c0d5a4-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:47 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 1073741824" returned: 0 in 0.561s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:47 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 Sep 01 12:45:47 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:48 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725471f2-9db0-4705-98f6-865cc29d69a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25787f07-0218-48f3-b9da-643f09d21221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:48 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Volume volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 (3ce5d141-1033-49d0-8faf-aaa7af4e29d0): created successfully Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25787f07-0218-48f3-b9da-643f09d21221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Flow 'volume_create_manager' (a637f869-adad-40d8-b0e2-23cd8c7eaebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f7122ca3-5e71-471c-b414-acc19155dfb4 tempest-CinderUnicodeTest-1569177303 None] Created volume successfully. Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "cinder-62645d8a-1f9f-4cb6-8957-0c50b134768b-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-62645d8a-1f9f-4cb6-8957-0c50b134768b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "cinder-quobyte-62645d8a-1f9f-4cb6-8957-0c50b134768b" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-62645d8a-1f9f-4cb6-8957-0c50b134768b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Deleting offline snapshot 62645d8a-1f9f-4cb6-8957-0c50b134768b of volume dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] snapshot_file for this snap is: volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f168d-742f-4ebf-80a1-f974d10fd3e1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:48 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b Sep 01 12:45:48 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:48 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909c345-6e9b-442b-969e-1abd6d4b59cb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:48 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 Sep 01 12:45:48 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:49 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" returned: 0 in 0.472s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:49 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b Sep 01 12:45:49 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:49 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b" returned: 0 in 0.495s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:49 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b Sep 01 12:45:49 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Flow 'volume_create_manager' (529ebe31-1a84-4227-a6e5-539c576e15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17700e21-de35-49de-a81b-b7e9afd12e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17700e21-de35-49de-a81b-b7e9afd12e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1311651045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb625048-0d36-43c0-a24a-821c7e276c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b64844198b4509b98a93935512c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:50Z,use_quota=True,user_id='6b3e4725a0294607a2d7ee04ede3fff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b22c8-a3fe-44d5-8d89-d24ffc15e02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603b22c8-a3fe-44d5-8d89-d24ffc15e02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3958ce9e-f5e7-40bb-a691-c20e74028c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3958ce9e-f5e7-40bb-a691-c20e74028c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb625048-0d36-43c0-a24a-821c7e276c93', 'volume_name': 'volume-bb625048-0d36-43c0-a24a-821c7e276c93', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322b81cf-991d-4d6f-b38e-b1b7cb57e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322b81cf-991d-4d6f-b38e-b1b7cb57e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd54b46-942f-433d-b0ee-f757079fb0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Volume bb625048-0d36-43c0-a24a-821c7e276c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb625048-0d36-43c0-a24a-821c7e276c93', 'volume_size': 1} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1311651045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb625048-0d36-43c0-a24a-821c7e276c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b64844198b4509b98a93935512c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:50Z,use_quota=True,user_id='6b3e4725a0294607a2d7ee04ede3fff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Creating volume bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:49 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:49 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 1073741824 Sep 01 12:45:49 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-e7b45024-fb2b-4a48-a1a2-7cba22ac1381 req-92bb9ccd-6c7f-4d33-b7f8-95639fee2302 tempest-AttachVolumeNegativeTest-2061541993 None] Terminate volume connection completed successfully. Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-e7b45024-fb2b-4a48-a1a2-7cba22ac1381 req-92bb9ccd-6c7f-4d33-b7f8-95639fee2302 tempest-AttachVolumeNegativeTest-2061541993 None] Deleting attachment 86cc4ffd-5cca-4862-8b97-5089bc001ef9. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:45:50 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64.62645d8a-1f9f-4cb6-8957-0c50b134768b" returned: 0 in 0.372s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-62645d8a-1f9f-4cb6-8957-0c50b134768b" released by "_delete_snapshot" :: held 1.905s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" released by "delete_snapshot" :: held 1.933s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Created reservations ['056b51af-0a3a-4727-9f28-a70a5deaae1a', '024b8341-ac34-46f3-a80e-12f186b9b769', '3a7a2311-8665-4ce3-af7f-eb2be7f4a1fe', '1ce7dfce-3fad-4f64-b1f8-bda6b3d835cc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Delete snapshot completed successfully. Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b5bde529-123b-42ab-b3c9-fd740427a621 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-62645d8a-1f9f-4cb6-8957-0c50b134768b-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "cinder-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:50 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 1073741824" returned: 0 in 0.722s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d174a9-7209-4858-b866-ee3bbaaf1d80]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:50 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 Sep 01 12:45:50 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:50 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 Sep 01 12:45:50 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:51 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd54b46-942f-433d-b0ee-f757079fb0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb625048-0d36-43c0-a24a-821c7e276c93', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06687934-0431-47c7-9459-c06c2d625bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:51 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Volume volume-bb625048-0d36-43c0-a24a-821c7e276c93 (bb625048-0d36-43c0-a24a-821c7e276c93): created successfully Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06687934-0431-47c7-9459-c06c2d625bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:51 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Flow 'volume_create_manager' (529ebe31-1a84-4227-a6e5-539c576e15c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" returned: 0 in 0.492s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5abf9359-cac5-47a6-9d81-ca094cf76592 tempest-CinderUnicodeTest-1569177303 None] Created volume successfully. Sep 01 12:45:51 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64 Sep 01 12:45:51 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:51 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-quobyte-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64" released by "delete_volume" :: held 1.007s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Created reservations ['ae8396d6-3d4f-44f1-8d25-8e4a9f4ff2e9', '7fba109d-18d0-4f2e-a8c4-f4e1e5c3ea36', '0028f394-adce-452b-b345-a44a090ca0ba', '25f5e1f1-e324-46be-8bf4-02fd4e9bd9cc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:51 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:51 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:52 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Deleted volume successfully. Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-332c1731-f436-481f-8aa0-f04a3289df07 tempest-VolumesSnapshotNegativeTestJSON-1619940893 None] Lock "cinder-dcdaa3f8-1c94-4ae7-81f9-962a64ff1b64-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Creating offline snapshot 33699947-ce7a-4192-aa46-9d659f78bc8b of volume bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8cdde-18fe-400d-b16d-91c58f6eef85]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:52 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 Sep 01 12:45:52 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:52 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93" returned: 0 in 0.447s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:52 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b 1G Sep 01 12:45:52 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:53 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b 1G" returned: 0 in 0.673s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb625048-0d36-43c0-a24a-821c7e276c93 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:53 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb625048-0d36-43c0-a24a-821c7e276c93 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b Sep 01 12:45:53 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:53 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb625048-0d36-43c0-a24a-821c7e276c93 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b" returned: 0 in 0.410s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:53 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b is being set with open permissions: ugo+rw Sep 01 12:45:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:53 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b Sep 01 12:45:53 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:54 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b" returned: 0 in 0.318s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:54 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info Sep 01 12:45:54 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:54 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:54 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info is being set with open permissions: ugo+rw Sep 01 12:45:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:54 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info Sep 01 12:45:54 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:55 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.info" returned: 0 in 0.291s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6c2cb803-3ef6-46b1-9cc2-73271790d2d3 tempest-CinderUnicodeTest-1569177303 None] Create snapshot completed successfully Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-93ef43b5-b047-4ce6-9c8f-66ffd58f3262-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-33699947-ce7a-4192-aa46-9d659f78bc8b-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-93ef43b5-b047-4ce6-9c8f-66ffd58f3262-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-33699947-ce7a-4192-aa46-9d659f78bc8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-quobyte-33699947-ce7a-4192-aa46-9d659f78bc8b" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-quobyte-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-33699947-ce7a-4192-aa46-9d659f78bc8b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Deleting offline snapshot 33699947-ce7a-4192-aa46-9d659f78bc8b of volume bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] snapshot_file for this snap is: volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" acquired by "delete_volume" :: waited 0.061s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0d786-3967-49e1-9b43-09597b501dbe]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab0839-f4d3-4b9f-bd8b-99cd94264b1f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:55 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b Sep 01 12:45:55 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:55 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 Sep 01 12:45:55 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:56 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b" returned: 0 in 0.432s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb625048-0d36-43c0-a24a-821c7e276c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d600b-82a4-4510-9690-153b30d9e6f6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:56 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" returned: 0 in 0.495s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:56 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262 Sep 01 12:45:56 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:56 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 Sep 01 12:45:56 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:56 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-93ef43b5-b047-4ce6-9c8f-66ffd58f3262" released by "delete_volume" :: held 0.923s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Created reservations ['efd74b5c-a720-48e5-adc9-546eb9e2850d', '9357ffcd-a892-42a6-b354-cb724dd89b20', '01947435-292f-47b7-9111-dfcab2dbdcdb', '0917509a-1af5-4719-bd2c-b78eac9790df'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:56 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93" returned: 0 in 0.563s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:56 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b Sep 01 12:45:56 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:56 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:56 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Flow 'volume_create_manager' (2a417d65-34ee-4afb-a99a-2b429482a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab624b6-4744-437f-93ec-397ae97914ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab624b6-4744-437f-93ec-397ae97914ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051946786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9d331c-c484-4af2-af5d-4cd7c7766f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f732e05963c4bb69f4cac3c40e8d3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:57Z,use_quota=True,user_id='d9f3a3041455402198bce493f9661329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4695cc-30ae-48a1-bd62-67e0b4be39c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4695cc-30ae-48a1-bd62-67e0b4be39c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ac1d17-f1bc-462e-a6da-66f527a87c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:45:57 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:57 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b Sep 01 12:45:57 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:57 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.431s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Deleted volume successfully. Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3845a330-747b-4c43-b4bf-baf7912b88e1 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-93ef43b5-b047-4ce6-9c8f-66ffd58f3262-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ac1d17-f1bc-462e-a6da-66f527a87c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f9d331c-c484-4af2-af5d-4cd7c7766f77', 'volume_name': 'volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd8f615-1316-4f03-b454-7819976a5a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd8f615-1316-4f03-b454-7819976a5a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27099bd6-e8ab-4fb6-b141-1fb8afdc377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:45:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Trying to clone 1f9d331c-c484-4af2-af5d-4cd7c7766f77 from image 903fc775-9c21-408b-9650-9b60d3b1eb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:45:57 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93.33699947-ce7a-4192-aa46-9d659f78bc8b" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-33699947-ce7a-4192-aa46-9d659f78bc8b" released by "_delete_snapshot" :: held 1.894s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" released by "delete_snapshot" :: held 1.941s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Created reservations ['3c5c23c8-12dd-44e7-95cc-a4c424b92edb', '1095cef0-f436-4e6f-b3ef-25ee82429541', 'ca9e3798-df48-4d36-8456-c36c09cdaf10', 'ed103765-cc7a-4cae-be24-20b7bfc9a638'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:45:57 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:45:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Delete snapshot completed successfully. Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-886a7a77-aba0-4884-a7af-76761c5c0999 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-33699947-ce7a-4192-aa46-9d659f78bc8b-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d74a8-b627-4c6d-a5a0-2208e0fd00d5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-quobyte-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:58 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD Sep 01 12:45:58 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec21de-76c3-4f0b-8056-08e67c53dbc7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:58 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 Sep 01 12:45:58 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:58 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 is fetched for user d9f3a3041455402198bce493f9661329. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9968fe-6fce-4219-b8a7-0c9a9b8178d6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:58 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" returned: 0 in 0.466s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:58 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD Sep 01 12:45:58 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:58 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1 Sep 01 12:45:58 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-bb625048-0d36-43c0-a24a-821c7e276c93-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-bb625048-0d36-43c0-a24a-821c7e276c93-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:58 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051946786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9d331c-c484-4af2-af5d-4cd7c7766f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f732e05963c4bb69f4cac3c40e8d3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:45:57Z,use_quota=True,user_id='d9f3a3041455402198bce493f9661329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Creating volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:45:58 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:58 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1073741824 Sep 01 12:45:58 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:45:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:45:59 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" returned: 0 in 0.390s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1" released by "delete_volume" :: held 0.905s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08f088-3f7d-4f65-93e3-0ed8c56747ad]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Created reservations ['297c8d0b-0841-4c86-9ded-453bd2f22612', 'f2c79f09-c61c-403b-8a3e-a221e7bd4e01', 'f8411d48-a807-4543-a1e0-af2bbc509dfd', 'bf3939d2-f7d0-48fc-902b-0795c48ab5f4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:45:59 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 Sep 01 12:45:59 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:59 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:45:59 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:59 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1073741824" returned: 0 in 0.614s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93" returned: 0 in 0.539s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:59 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:45:59 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93 Sep 01 12:45:59 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Deleted volume successfully. Sep 01 12:45:59 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 Sep 01 12:45:59 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e27c347e-75f4-46b9-b997-cd57cd1c1d5c tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-67e3670f-dd27-4225-a7f6-7b23b4e7c3f1-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:59 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bb625048-0d36-43c0-a24a-821c7e276c93" returned: 0 in 0.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-bb625048-0d36-43c0-a24a-821c7e276c93" released by "delete_volume" :: held 0.918s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:45:59 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Attempting download of 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:45:59 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Created reservations ['d12426d8-bd30-4813-808d-6c518155e111', '078a36a4-e003-4261-ad89-aef95c6647bf', '5bf57b75-c47e-43a2-8915-1f13b9de9051', '481b838c-711e-4c5b-95bb-7a6a6cf4f197'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[57358787-2f03-4c90-8141-0360c2639382]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:00 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:00 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:00 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u Sep 01 12:46:00 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:00 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.353s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Deleted volume successfully. Sep 01 12:46:00 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u" returned: 0 in 0.432s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5f9b9886-049d-46ba-9315-86ed44259405 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-bb625048-0d36-43c0-a24a-821c7e276c93-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-7298358d-ee7a-4e38-94f8-b2fb75d69112-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-7298358d-ee7a-4e38-94f8-b2fb75d69112-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:00 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u Sep 01 12:46:00 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "cinder-quobyte-7298358d-ee7a-4e38-94f8-b2fb75d69112" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-7298358d-ee7a-4e38-94f8-b2fb75d69112" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[70590886-ec10-4c8d-ba41-168f83010874]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:00 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 Sep 01 12:46:00 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:00 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u" returned: 1 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_2eeamh2u' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd324bb-c2ed-4e99-aa8c-9adaa7ed2c73]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD Sep 01 12:46:01 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-3ce5d141-1033-49d0-8faf-aaa7af4e29d0-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-3ce5d141-1033-49d0-8faf-aaa7af4e29d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:01 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112" returned: 0 in 0.468s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "cinder-quobyte-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:01 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112 Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:01 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629c348-825b-48db-b691-d551382bfb3e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] 903fc775-9c21-408b-9650-9b60d3b1eb91 was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 Sep 01 12:46:01 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:01 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 Sep 01 12:46:01 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:01 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-7298358d-ee7a-4e38-94f8-b2fb75d69112" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-quobyte-7298358d-ee7a-4e38-94f8-b2fb75d69112" released by "delete_volume" :: held 0.883s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Created reservations ['511fbb87-7683-48dc-9dc6-e806b0dc0f4d', '27573087-9862-4d61-b833-45c7fcd93e66', '04c05560-88cf-4b66-94cd-bc0e28be0160', '674178f8-416b-44d6-a526-2072371acd0a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" returned: 0 in 0.463s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:01 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:01 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:01 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0 Sep 01 12:46:01 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:02 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.335s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Deleted volume successfully. Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-91577d66-53b5-4848-a886-3d159d6f0a45 tempest-AttachVolumeNegativeTest-2061541993 None] Lock "cinder-7298358d-ee7a-4e38-94f8-b2fb75d69112-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:02 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" returned: 0 in 0.501s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-quobyte-3ce5d141-1033-49d0-8faf-aaa7af4e29d0" released by "delete_volume" :: held 1.032s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Created reservations ['1003ccbb-72a6-406e-a3d2-259ebeebdf15', '948c5644-45e7-45e0-a222-fe9b4cc18731', '3c8d6ee7-d4a3-4f42-be2e-6e2ebbb715fa', '058b9b62-1dd1-4625-bd59-bcebe05a6037'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:02 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:02 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:02 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.319s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Deleted volume successfully. Sep 01 12:46:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5009227d-6bf0-4149-b1c1-37a55f891511 tempest-CinderUnicodeTest-1569177303 None] Lock "cinder-3ce5d141-1033-49d0-8faf-aaa7af4e29d0-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:03 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77" returned: 0 in 2.526s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:03 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_cvu0cn55devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:46:03 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Converted 112.00 MB image at 44.32 MB/s Sep 01 12:46:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:03 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1G Sep 01 12:46:03 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:04 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 1G" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Downloaded image 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 for user d9f3a3041455402198bce493f9661329 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Marking volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Copying metadata from image 903fc775-9c21-408b-9650-9b60d3b1eb91 to 1f9d331c-c484-4af2-af5d-4cd7c7766f77. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Creating volume glance metadata for volume 1f9d331c-c484-4af2-af5d-4cd7c7766f77 backed by image 903fc775-9c21-408b-9650-9b60d3b1eb91 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27099bd6-e8ab-4fb6-b141-1fb8afdc377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c009a4-b596-4ee4-802e-be20822d72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:04 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Volume volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 (1f9d331c-c484-4af2-af5d-4cd7c7766f77): created successfully Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c009a4-b596-4ee4-802e-be20822d72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Flow 'volume_create_manager' (2a417d65-34ee-4afb-a99a-2b429482a833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-741482fb-7fef-4a44-a36f-4a83dddcfeb1 tempest-VolumesExtendTest-467223818 None] Created volume successfully. Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[42420b86-edad-4b5f-b257-603c8cd883c9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:04 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 Sep 01 12:46:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:05 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77" returned: 0 in 0.413s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 2G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 2G" returned: 0 in 0.157s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.600s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-38118290-8711-4426-896a-02a3c57f69f3 tempest-VolumesExtendTest-467223818 None] Extend volume completed successfully. Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-1f9d331c-c484-4af2-af5d-4cd7c7766f77-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "cinder-1f9d331c-c484-4af2-af5d-4cd7c7766f77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-quobyte-1f9d331c-c484-4af2-af5d-4cd7c7766f77" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-1f9d331c-c484-4af2-af5d-4cd7c7766f77" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c221eed7-b53c-4838-ba3e-1595b5f9ac71]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:06 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 Sep 01 12:46:06 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:06 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77" returned: 0 in 0.435s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:06 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77 Sep 01 12:46:06 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:07 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1f9d331c-c484-4af2-af5d-4cd7c7766f77" returned: 0 in 0.354s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-1f9d331c-c484-4af2-af5d-4cd7c7766f77" released by "delete_volume" :: held 0.852s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Created reservations ['3f5003bd-d6b1-4c90-a92d-201bc2de1243', 'e9a4a0e8-5c95-4469-9c7f-955f9b5ee534', 'b63884ef-aaba-4a50-b9c2-448465e2affb', '4978b155-6376-4b75-9f17-d651ab76f121'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:07 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:07 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:07 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Deleted volume successfully. Sep 01 12:46:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e731f81e-2e05-4acd-9998-ca17e16ba90f tempest-VolumesExtendTest-467223818 None] Lock "cinder-1f9d331c-c484-4af2-af5d-4cd7c7766f77-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Flow 'volume_create_manager' (32b09a64-50b0-4195-a163-8f0daf5dd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f735ec-8461-491a-8785-727501e5ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f735ec-8461-491a-8785-727501e5ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1743454430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8811250e-ade0-4ff9-b661-c0c6915acf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f732e05963c4bb69f4cac3c40e8d3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:08Z,use_quota=True,user_id='d9f3a3041455402198bce493f9661329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3289ff65-2ec0-41cb-9227-08f1449aca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3289ff65-2ec0-41cb-9227-08f1449aca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475b9461-ba37-4d14-b34e-90d53333887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475b9461-ba37-4d14-b34e-90d53333887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8811250e-ade0-4ff9-b661-c0c6915acf5a', 'volume_name': 'volume-8811250e-ade0-4ff9-b661-c0c6915acf5a', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b0256-f929-4c43-ad8c-e8e5c901e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b0256-f929-4c43-ad8c-e8e5c901e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee07afd-c567-4082-9bd7-b4d93850e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Volume 8811250e-ade0-4ff9-b661-c0c6915acf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8811250e-ade0-4ff9-b661-c0c6915acf5a', 'volume_size': 1} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1743454430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8811250e-ade0-4ff9-b661-c0c6915acf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f732e05963c4bb69f4cac3c40e8d3ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:08Z,use_quota=True,user_id='d9f3a3041455402198bce493f9661329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Creating volume 8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:08 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:08 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a 1073741824 Sep 01 12:46:08 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:08 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a 1073741824" returned: 0 in 0.704s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:09 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:09 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:09 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.351s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee07afd-c567-4082-9bd7-b4d93850e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8811250e-ade0-4ff9-b661-c0c6915acf5a', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c2602e-9e79-4db3-80f2-808a88fefe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Volume volume-8811250e-ade0-4ff9-b661-c0c6915acf5a (8811250e-ade0-4ff9-b661-c0c6915acf5a): created successfully Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c2602e-9e79-4db3-80f2-808a88fefe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Flow 'volume_create_manager' (32b09a64-50b0-4195-a163-8f0daf5dd431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6d5e700f-81fb-4a92-8bc9-40465575b663 tempest-VolumesExtendTest-467223818 None] Created volume successfully. Sep 01 12:46:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Creating offline snapshot 524e5488-c1ad-48a7-b122-cf446df4ea1d of volume 8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:46:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c63c12-8ce0-499d-a761-94c5f7bf4542]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:10 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:10 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:11 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.637s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:11 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d 1G Sep 01 12:46:11 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:11 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d 1G" returned: 0 in 0.671s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8811250e-ade0-4ff9-b661-c0c6915acf5a -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:12 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8811250e-ade0-4ff9-b661-c0c6915acf5a -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d Sep 01 12:46:12 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:12 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8811250e-ade0-4ff9-b661-c0c6915acf5a -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d" returned: 0 in 0.467s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:12 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d is being set with open permissions: ugo+rw Sep 01 12:46:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:12 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d Sep 01 12:46:12 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:12 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d" returned: 0 in 0.346s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:12 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info Sep 01 12:46:12 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:13 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:13 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info is being set with open permissions: ugo+rw Sep 01 12:46:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:13 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info Sep 01 12:46:13 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:13 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.info" returned: 0 in 0.280s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-50fc2846-b40a-4d09-a2ca-fd37eae55fd7 tempest-VolumesExtendTest-467223818 None] Create snapshot completed successfully Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce062d9-afd0-4a11-a41c-7d57355a8643]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:14 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:14 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:14 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.505s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d 2G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d 2G" returned: 0 in 0.138s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9d0432e0-93ad-415c-8666-a77dc9e5425b tempest-VolumesExtendTest-467223818 None] Extend volume completed successfully. Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-524e5488-c1ad-48a7-b122-cf446df4ea1d-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-524e5488-c1ad-48a7-b122-cf446df4ea1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-quobyte-524e5488-c1ad-48a7-b122-cf446df4ea1d" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-524e5488-c1ad-48a7-b122-cf446df4ea1d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Deleting offline snapshot 524e5488-c1ad-48a7-b122-cf446df4ea1d of volume 8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] snapshot_file for this snap is: volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28fce05-f358-4ecd-a893-b2814c514d07]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:15 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d Sep 01 12:46:15 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:16 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d" returned: 0 in 0.489s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8811250e-ade0-4ff9-b661-c0c6915acf5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[754b1162-cf96-4004-949b-502b2d1c6ec9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:16 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:16 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:16 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.508s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:16 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d Sep 01 12:46:16 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:17 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d" returned: 0 in 0.593s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:17 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d Sep 01 12:46:17 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:17 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a.524e5488-c1ad-48a7-b122-cf446df4ea1d" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-524e5488-c1ad-48a7-b122-cf446df4ea1d" released by "_delete_snapshot" :: held 2.068s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" released by "delete_snapshot" :: held 2.099s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Created reservations ['3943bdab-26d7-4de2-8e37-839bdfad6d15', '2e005a01-d608-48d3-acbb-e8cd4a72b7ed', '5f8fda27-7cd9-438c-86aa-0b5bb84ed6b0', '548405ea-b5ca-4d6b-b17f-93a34dd168a9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Delete snapshot completed successfully. Sep 01 12:46:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cba9cd44-e6c1-4472-b105-8f6e04b5607e tempest-VolumesExtendTest-467223818 None] Lock "cinder-524e5488-c1ad-48a7-b122-cf446df4ea1d-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-8811250e-ade0-4ff9-b661-c0c6915acf5a-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "cinder-8811250e-ade0-4ff9-b661-c0c6915acf5a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Acquiring lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" acquired by "delete_volume" :: waited 0.067s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de7e58-06e0-49ea-906f-6b95f1497022]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:19 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:19 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:19 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.518s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:19 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a Sep 01 12:46:19 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:19 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8811250e-ade0-4ff9-b661-c0c6915acf5a" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "cinder-quobyte-8811250e-ade0-4ff9-b661-c0c6915acf5a" released by "delete_volume" :: held 0.928s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:19 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Created reservations ['ff558a13-442c-4dc4-a9ed-90b3a24c98d8', 'cbb500a6-677c-4953-a336-98e9c5350025', 'fac45d6f-1386-43f8-acb6-759d3a9562c3', 'f6cbc47f-a96b-464c-ba34-7a3baa7d3924'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:20 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:20 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:20 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Deleted volume successfully. Sep 01 12:46:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d1b5d1d2-938f-4ccb-9475-a83e30cb75cf tempest-VolumesExtendTest-467223818 None] Lock "cinder-8811250e-ade0-4ff9-b661-c0c6915acf5a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Flow 'volume_create_manager' (fd3f935c-edeb-49c5-a0c4-40a55414f06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18990b-24a4-403e-99d2-3b8f9596c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18990b-24a4-403e-99d2-3b8f9596c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-499722039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836f0dd2-4242-4661-806b-d72b5ee06596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d019e7d35674e14a3f338b0c5cdbcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:21Z,use_quota=True,user_id='ff2541350e174535abfe337fb0a858e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2b2a40-df8b-497d-bf3d-412bd31a13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2b2a40-df8b-497d-bf3d-412bd31a13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef7d10b-3cbc-408d-b14f-c5ca099cb2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef7d10b-3cbc-408d-b14f-c5ca099cb2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836f0dd2-4242-4661-806b-d72b5ee06596', 'volume_name': 'volume-836f0dd2-4242-4661-806b-d72b5ee06596', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077cdbc-9a27-401a-b626-067c0044aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e077cdbc-9a27-401a-b626-067c0044aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe9a6bf-9823-439c-948a-2ed63073a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Volume 836f0dd2-4242-4661-806b-d72b5ee06596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836f0dd2-4242-4661-806b-d72b5ee06596', 'volume_size': 1} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-499722039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836f0dd2-4242-4661-806b-d72b5ee06596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d019e7d35674e14a3f338b0c5cdbcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:21Z,use_quota=True,user_id='ff2541350e174535abfe337fb0a858e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Creating volume 836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:21 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:21 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 1073741824 Sep 01 12:46:21 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:22 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 1073741824" returned: 0 in 0.549s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:22 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 Sep 01 12:46:22 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:22 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596" returned: 0 in 0.330s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe9a6bf-9823-439c-948a-2ed63073a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836f0dd2-4242-4661-806b-d72b5ee06596', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f6c015-e890-401d-95a8-703935898687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Volume volume-836f0dd2-4242-4661-806b-d72b5ee06596 (836f0dd2-4242-4661-806b-d72b5ee06596): created successfully Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f6c015-e890-401d-95a8-703935898687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Flow 'volume_create_manager' (fd3f935c-edeb-49c5-a0c4-40a55414f06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-190b318b-ac0e-4dd8-b910-27451497278d req-abb6eb40-2714-41ae-a741-ffd562bc202b tempest-VolumesSnapshotsTestJSON-2095632000 None] Created volume successfully. Sep 01 12:46:23 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:INSERT=44,cinder:UPDATE=144,cinder:SELECT=110,cinder:DELETE=11 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:46:23 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=122,cinder:UPDATE=126,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:46:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Creating offline snapshot b7be2541-e976-44d0-87f7-1de9e1e83390 of volume 836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:46:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f8454-b251-4ee8-883a-3fbfe869de04]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:24 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 Sep 01 12:46:24 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:24 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596" returned: 0 in 0.493s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:24 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 1G Sep 01 12:46:24 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:25 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 1G" returned: 0 in 0.520s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836f0dd2-4242-4661-806b-d72b5ee06596 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:25 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836f0dd2-4242-4661-806b-d72b5ee06596 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 Sep 01 12:46:25 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:25 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836f0dd2-4242-4661-806b-d72b5ee06596 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:25 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 is being set with open permissions: ugo+rw Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:25 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 Sep 01 12:46:25 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:25 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390" returned: 0 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:25 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info Sep 01 12:46:25 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:26 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:26 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info is being set with open permissions: ugo+rw Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:26 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info Sep 01 12:46:26 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:26 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:26 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:26 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.info" returned: 0 in 0.470s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-1ec4e658-41de-4945-bc19-308c01d4bade req-15b76ead-e736-4e81-a92a-b7a3f4374665 tempest-VolumesSnapshotsTestJSON-2095632000 None] Create snapshot completed successfully Sep 01 12:46:26 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.291s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:46:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "cinder-b7be2541-e976-44d0-87f7-1de9e1e83390-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-b7be2541-e976-44d0-87f7-1de9e1e83390-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "cinder-quobyte-b7be2541-e976-44d0-87f7-1de9e1e83390" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-b7be2541-e976-44d0-87f7-1de9e1e83390" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Deleting offline snapshot b7be2541-e976-44d0-87f7-1de9e1e83390 of volume 836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] snapshot_file for this snap is: volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3eabfd-d70c-40d0-bffa-0a8817002f58]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:28 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 Sep 01 12:46:28 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (d7c081c1-f122-416c-9059-5b291ac68e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90807c-44d0-470c-9a8b-9bb775571e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90807c-44d0-470c-9a8b-9bb775571e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829196503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a039e-6310-4c32-b583-2df33e464b47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:28Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65facb7f-c772-4b8b-99db-45cca33885a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65facb7f-c772-4b8b-99db-45cca33885a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e126d03-94ca-4a05-9a9c-362be34f3dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e126d03-94ca-4a05-9a9c-362be34f3dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5a039e-6310-4c32-b583-2df33e464b47', 'volume_name': 'volume-5c5a039e-6310-4c32-b583-2df33e464b47', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079892ce-fb1d-4b24-95ed-145061a8ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079892ce-fb1d-4b24-95ed-145061a8ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67224753-824f-4649-882e-8672591e0997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:28 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Volume 5c5a039e-6310-4c32-b583-2df33e464b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5a039e-6310-4c32-b583-2df33e464b47', 'volume_size': 1} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829196503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a039e-6310-4c32-b583-2df33e464b47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:28Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Creating volume 5c5a039e-6310-4c32-b583-2df33e464b47 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:28 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:28 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 1073741824 Sep 01 12:46:28 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:28 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390" returned: 0 in 0.516s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836f0dd2-4242-4661-806b-d72b5ee06596(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ffe2d6-fe00-44bd-9b5a-e7eb2a8389fd]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:28 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 Sep 01 12:46:28 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:28 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 1073741824" returned: 0 in 0.627s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:28 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 Sep 01 12:46:28 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:28 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596" returned: 0 in 0.471s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:28 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 Sep 01 12:46:28 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:29 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47" returned: 0 in 0.332s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67224753-824f-4649-882e-8672591e0997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5a039e-6310-4c32-b583-2df33e464b47', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86a97fe-12bb-4bd6-9a9e-76ba94e6c442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Volume volume-5c5a039e-6310-4c32-b583-2df33e464b47 (5c5a039e-6310-4c32-b583-2df33e464b47): created successfully Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86a97fe-12bb-4bd6-9a9e-76ba94e6c442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (d7c081c1-f122-416c-9059-5b291ac68e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f80c1ce-2603-4d97-89d1-4c5ccf173028 tempest-VolumesListTestJSON-929783578 None] Created volume successfully. Sep 01 12:46:29 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390" returned: 0 in 0.707s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:29 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390 Sep 01 12:46:29 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:30 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596.b7be2541-e976-44d0-87f7-1de9e1e83390" returned: 0 in 0.473s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-b7be2541-e976-44d0-87f7-1de9e1e83390" released by "_delete_snapshot" :: held 2.368s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" released by "delete_snapshot" :: held 2.425s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:30 devstack cinder-volume[87008]: DEBUG cinder.quota [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Created reservations ['24c6fc66-eef7-49c7-9ba4-2b11507ff2f3', '44772a57-fd42-4c64-832f-50b19636b0d0', '53ebb8b1-e05c-4862-9282-9c60a5494777', '7f5a0b86-ad0f-4b6d-b330-58801f59d6a0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Delete snapshot completed successfully. Sep 01 12:46:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0f7b304c-8453-44fd-9c34-38b5e1091009 req-28703384-76ea-4216-a7a7-58f94fc69971 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-b7be2541-e976-44d0-87f7-1de9e1e83390-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (b85aee0c-5138-453c-8bc1-29a63c758efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07fa554-4da1-4d37-8406-ebf8082f8fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07fa554-4da1-4d37-8406-ebf8082f8fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-965692785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b6b1eb-346a-4e02-947e-6ceb3df434e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:31Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367352f6-c516-4da1-abc8-3812e3b273fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367352f6-c516-4da1-abc8-3812e3b273fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa60fde-eb91-4498-af03-605495d2e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa60fde-eb91-4498-af03-605495d2e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b6b1eb-346a-4e02-947e-6ceb3df434e7', 'volume_name': 'volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d264b97-4263-42e3-9da6-06a33f4d7f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d264b97-4263-42e3-9da6-06a33f4d7f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130978d7-7a65-4e3d-8adf-90cad9fde678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Volume b6b6b1eb-346a-4e02-947e-6ceb3df434e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7', 'volume_size': 1} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-965692785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b6b1eb-346a-4e02-947e-6ceb3df434e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:31Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Creating volume b6b6b1eb-346a-4e02-947e-6ceb3df434e7 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:31 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "cinder-836f0dd2-4242-4661-806b-d72b5ee06596-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:31 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 1073741824 Sep 01 12:46:31 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-836f0dd2-4242-4661-806b-d72b5ee06596-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d2716-ff04-4e0d-9e48-f5634b56a7f5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:31 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 Sep 01 12:46:31 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:32 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 1073741824" returned: 0 in 0.775s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:32 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596" returned: 0 in 0.550s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:32 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596 Sep 01 12:46:32 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:32 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 Sep 01 12:46:32 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:32 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-836f0dd2-4242-4661-806b-d72b5ee06596" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-quobyte-836f0dd2-4242-4661-806b-d72b5ee06596" released by "delete_volume" :: held 0.927s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:32 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" returned: 0 in 0.313s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130978d7-7a65-4e3d-8adf-90cad9fde678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641d810-e5c5-42d1-b316-86694a696f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Volume volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 (b6b6b1eb-346a-4e02-947e-6ceb3df434e7): created successfully Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641d810-e5c5-42d1-b316-86694a696f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (b85aee0c-5138-453c-8bc1-29a63c758efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3d414dbe-4331-4cd9-8b48-5e532a50069a tempest-VolumesListTestJSON-929783578 None] Created volume successfully. Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.quota [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Created reservations ['0e5b1b40-1bc3-49ec-a5a6-607fdc321fb7', 'db6920d6-1c72-484f-8522-7dced809020c', '982175c0-82aa-401a-b515-bb8d807fa4e4', '8abedbfa-c859-4554-b014-ab710e89347e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:32 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:32 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:32 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.311s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.manager [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Deleted volume successfully. Sep 01 12:46:32 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-79c90640-c165-401f-9bde-77030282f5eb req-d215a5b7-5520-4f6f-b5e1-5898424f24a9 tempest-VolumesSnapshotsTestJSON-2095632000 None] Lock "cinder-836f0dd2-4242-4661-806b-d72b5ee06596-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (5518cf24-9c60-43f5-b2a9-363f037c2eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1150bb4-27ab-46db-a2d6-6e61d98c7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1150bb4-27ab-46db-a2d6-6e61d98c7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1802831429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e4bf33-753b-4b00-b974-6755c4b1bba2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:34Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebb4171-28af-4e8a-ad65-62e2e0a7f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebb4171-28af-4e8a-ad65-62e2e0a7f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9a3408-d5ab-4f6e-9371-48495cd93a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9a3408-d5ab-4f6e-9371-48495cd93a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e4bf33-753b-4b00-b974-6755c4b1bba2', 'volume_name': 'volume-63e4bf33-753b-4b00-b974-6755c4b1bba2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a5b715-13a7-40d1-aa8f-af96ee6200c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a5b715-13a7-40d1-aa8f-af96ee6200c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024c02bb-cf37-4230-88bd-ca50c339c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Volume 63e4bf33-753b-4b00-b974-6755c4b1bba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e4bf33-753b-4b00-b974-6755c4b1bba2', 'volume_size': 1} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1802831429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e4bf33-753b-4b00-b974-6755c4b1bba2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3acf9b1aae7f4bf4a3c7ccfcf1ce229b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:34Z,use_quota=True,user_id='db455a6b76e34201a799967488c5c7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Creating volume 63e4bf33-753b-4b00-b974-6755c4b1bba2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:34 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 1073741824 Sep 01 12:46:34 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:34 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 1073741824" returned: 0 in 0.532s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:34 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 Sep 01 12:46:34 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:34 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024c02bb-cf37-4230-88bd-ca50c339c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e4bf33-753b-4b00-b974-6755c4b1bba2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0be31b-dc69-4f99-89a0-3fe4304e4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Volume volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 (63e4bf33-753b-4b00-b974-6755c4b1bba2): created successfully Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0be31b-dc69-4f99-89a0-3fe4304e4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Flow 'volume_create_manager' (5518cf24-9c60-43f5-b2a9-363f037c2eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2c35fbc3-b46c-4069-ad3f-ecd35d20ae6a tempest-VolumesListTestJSON-929783578 None] Created volume successfully. Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-63e4bf33-753b-4b00-b974-6755c4b1bba2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "cinder-63e4bf33-753b-4b00-b974-6755c4b1bba2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-quobyte-63e4bf33-753b-4b00-b974-6755c4b1bba2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-63e4bf33-753b-4b00-b974-6755c4b1bba2" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[44726a8e-d9a7-4f13-a3b2-b625811d12fb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:38 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 Sep 01 12:46:38 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (b4ff83c3-b7e0-4c6d-af2c-68f4e9c8dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cba8b1-99ee-4392-9167-fc54a1aad39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cba8b1-99ee-4392-9167-fc54a1aad39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1352384782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b84907e-3fb7-4e32-98a5-e6b52181638e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:38Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953b2226-3c1f-40e1-8ea6-3d685bc273cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953b2226-3c1f-40e1-8ea6-3d685bc273cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17148b76-9be9-4123-9672-95a45a0a4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17148b76-9be9-4123-9672-95a45a0a4fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b84907e-3fb7-4e32-98a5-e6b52181638e', 'volume_name': 'volume-6b84907e-3fb7-4e32-98a5-e6b52181638e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8259dadf-b0c6-4d82-a2b7-918d71f3d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8259dadf-b0c6-4d82-a2b7-918d71f3d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf0376-18bf-4cd5-8e5d-9ea8ac9c8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:38 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Volume 6b84907e-3fb7-4e32-98a5-e6b52181638e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b84907e-3fb7-4e32-98a5-e6b52181638e', 'volume_size': 1} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1352384782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b84907e-3fb7-4e32-98a5-e6b52181638e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:38Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Creating volume 6b84907e-3fb7-4e32-98a5-e6b52181638e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:38 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e 1073741824 Sep 01 12:46:38 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:38 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2" returned: 0 in 0.383s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:38 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2 Sep 01 12:46:38 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:38 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-63e4bf33-753b-4b00-b974-6755c4b1bba2" returned: 0 in 0.265s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-63e4bf33-753b-4b00-b974-6755c4b1bba2" released by "delete_volume" :: held 0.695s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:38 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e 1073741824" returned: 0 in 0.469s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:38 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Created reservations ['1708c096-5002-4346-b3af-9dbf5d74fe86', '4f165cff-2cfe-49ac-8ee0-7aae3033c569', '4f677b86-d1d8-4fae-8398-d83b0e72ebb5', 'c47c8ecd-c5c1-4029-9cc5-f3351ca28bd3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:39 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e Sep 01 12:46:39 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:39 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:39 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:39 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e" returned: 0 in 0.341s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caf0376-18bf-4cd5-8e5d-9ea8ac9c8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b84907e-3fb7-4e32-98a5-e6b52181638e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f02ff51-774b-446f-92de-cb1aa7d0c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Volume volume-6b84907e-3fb7-4e32-98a5-e6b52181638e (6b84907e-3fb7-4e32-98a5-e6b52181638e): created successfully Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f02ff51-774b-446f-92de-cb1aa7d0c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (b4ff83c3-b7e0-4c6d-af2c-68f4e9c8dd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:39 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.318s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Deleted volume successfully. Sep 01 12:46:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-74530844-24e9-41cd-8a5d-b01b81878d71 tempest-VolumesTestJSON-1239076837 None] Created volume successfully. Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f709cfd-a9b6-4b42-8504-21eae13dd1d4 tempest-VolumesListTestJSON-929783578 None] Lock "cinder-63e4bf33-753b-4b00-b974-6755c4b1bba2-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-b6b6b1eb-346a-4e02-947e-6ceb3df434e7-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "cinder-b6b6b1eb-346a-4e02-947e-6ceb3df434e7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-quobyte-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e2dcb-6df4-4361-8ec0-a4df7bd2a2db]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:39 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 Sep 01 12:46:39 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:39 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" returned: 0 in 0.383s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:39 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7 Sep 01 12:46:39 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:40 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-b6b6b1eb-346a-4e02-947e-6ceb3df434e7" released by "delete_volume" :: held 0.688s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Created reservations ['6a1b2771-f48d-44f9-9ba7-23bc4622985b', '0ab24a31-388c-40ba-a08f-56b87736a064', 'b4e98f77-7583-482c-af39-8101f7cf7e46', '8d691ba7-c235-41a9-bb3e-4e01a2013d77'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:40 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:40 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:40 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Deleted volume successfully. Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-80bec7cb-fb03-4f15-9e52-12cbc1f4069f tempest-VolumesListTestJSON-929783578 None] Lock "cinder-b6b6b1eb-346a-4e02-947e-6ceb3df434e7-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-5c5a039e-6310-4c32-b583-2df33e464b47-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "cinder-5c5a039e-6310-4c32-b583-2df33e464b47-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Acquiring lock "cinder-quobyte-5c5a039e-6310-4c32-b583-2df33e464b47" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-5c5a039e-6310-4c32-b583-2df33e464b47" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd926152-d0df-41d5-ad4c-54c4b27985e1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:41 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 Sep 01 12:46:41 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (53aa6b1f-bc11-4805-9d9b-5466d58c08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1e3bd-ed55-4cbc-b2cc-160968839af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1e3bd-ed55-4cbc-b2cc-160968839af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99041605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710df472-c495-4f9c-965a-05250fb8492e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:41Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1678a9-3394-47ff-9ccb-8e69b623eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1678a9-3394-47ff-9ccb-8e69b623eb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950b6a75-1708-4fea-b594-9b72f436cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950b6a75-1708-4fea-b594-9b72f436cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710df472-c495-4f9c-965a-05250fb8492e', 'volume_name': 'volume-710df472-c495-4f9c-965a-05250fb8492e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd68cec9-cbd0-43fb-bde4-83476cc85fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd68cec9-cbd0-43fb-bde4-83476cc85fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e7ea34-7030-47d2-87b4-8f9219f04124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:41 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Volume 710df472-c495-4f9c-965a-05250fb8492e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710df472-c495-4f9c-965a-05250fb8492e', 'volume_size': 1} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99041605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710df472-c495-4f9c-965a-05250fb8492e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:41Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Creating volume 710df472-c495-4f9c-965a-05250fb8492e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:41 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:41 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e 1073741824 Sep 01 12:46:41 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:41 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:41 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47 Sep 01 12:46:41 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:41 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5c5a039e-6310-4c32-b583-2df33e464b47" returned: 0 in 0.270s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "cinder-quobyte-5c5a039e-6310-4c32-b583-2df33e464b47" released by "delete_volume" :: held 0.758s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Created reservations ['a53a283a-c78a-47af-a09b-53d5ab51c749', '49c23605-cb19-40da-b2b2-33ff549e700d', '08049fbb-03d8-4177-9641-cef07c60e30e', '969c4acc-6b02-4cce-824e-7a3e13a5771c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:41 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e 1073741824" returned: 0 in 0.469s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:41 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e Sep 01 12:46:41 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:41 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:41 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:42 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e" returned: 0 in 0.321s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e7ea34-7030-47d2-87b4-8f9219f04124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710df472-c495-4f9c-965a-05250fb8492e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec94a8-d228-46ed-ad86-b96663f7bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:42 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Volume volume-710df472-c495-4f9c-965a-05250fb8492e (710df472-c495-4f9c-965a-05250fb8492e): created successfully Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec94a8-d228-46ed-ad86-b96663f7bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (53aa6b1f-bc11-4805-9d9b-5466d58c08ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b089c38a-f668-46e0-9a8b-2b51892c9685 tempest-VolumesTestJSON-1239076837 None] Created volume successfully. Sep 01 12:46:42 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Deleted volume successfully. Sep 01 12:46:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbb91f48-05c2-453c-97ca-ebf6066e7c7e tempest-VolumesListTestJSON-929783578 None] Lock "cinder-5c5a039e-6310-4c32-b583-2df33e464b47-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (adbbe399-129d-496c-85b0-80de47e5a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d546d4f-31c0-41c5-808a-ab504fb8f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d546d4f-31c0-41c5-808a-ab504fb8f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1563793314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ffd12b-4f0d-40a2-acb0-007854477ca1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:44Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af1cb5-0894-403f-80b0-c732f69210c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1af1cb5-0894-403f-80b0-c732f69210c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67515dd-1e68-4939-b6e2-3170efc45fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67515dd-1e68-4939-b6e2-3170efc45fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ffd12b-4f0d-40a2-acb0-007854477ca1', 'volume_name': 'volume-17ffd12b-4f0d-40a2-acb0-007854477ca1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ca1659-6da1-4c37-8b2a-d66e8379e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ca1659-6da1-4c37-8b2a-d66e8379e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0377158a-7f74-445d-9f6c-1b6a43ae73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:43 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Volume 17ffd12b-4f0d-40a2-acb0-007854477ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ffd12b-4f0d-40a2-acb0-007854477ca1', 'volume_size': 1} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1563793314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ffd12b-4f0d-40a2-acb0-007854477ca1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f83d9e449bbc435cb469a3dc715ae92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:44Z,use_quota=True,user_id='e8ccf7b1ac884cfc8f0b35afa2966c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Creating volume 17ffd12b-4f0d-40a2-acb0-007854477ca1 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:44 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:44 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 1073741824 Sep 01 12:46:44 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:44 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 1073741824" returned: 0 in 0.460s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:44 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 Sep 01 12:46:44 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:44 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0377158a-7f74-445d-9f6c-1b6a43ae73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ffd12b-4f0d-40a2-acb0-007854477ca1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465a77a1-6df8-4c47-9d3f-92054f1fd1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:44 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Volume volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 (17ffd12b-4f0d-40a2-acb0-007854477ca1): created successfully Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465a77a1-6df8-4c47-9d3f-92054f1fd1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Flow 'volume_create_manager' (adbbe399-129d-496c-85b0-80de47e5a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8addad2c-18c8-42e9-8545-be6f4425966b tempest-VolumesTestJSON-1239076837 None] Created volume successfully. Sep 01 12:46:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-17ffd12b-4f0d-40a2-acb0-007854477ca1-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-17ffd12b-4f0d-40a2-acb0-007854477ca1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-quobyte-17ffd12b-4f0d-40a2-acb0-007854477ca1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-17ffd12b-4f0d-40a2-acb0-007854477ca1" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af80e81-598a-421b-b271-4360a62fed88]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:47 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 Sep 01 12:46:47 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:47 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1" returned: 0 in 0.440s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:47 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1 Sep 01 12:46:47 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:47 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17ffd12b-4f0d-40a2-acb0-007854477ca1" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-17ffd12b-4f0d-40a2-acb0-007854477ca1" released by "delete_volume" :: held 0.765s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Created reservations ['67f929e0-b11f-4dbe-ade4-686391d2f401', 'dbd0d40d-65eb-4def-8c09-8578fed15eb5', '48ab27db-3af5-445d-a221-67a60629438a', 'f4975076-5106-448d-9ca3-f7faaada1c7b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:48 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:48 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-710df472-c495-4f9c-965a-05250fb8492e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-710df472-c495-4f9c-965a-05250fb8492e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-quobyte-710df472-c495-4f9c-965a-05250fb8492e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:48 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-710df472-c495-4f9c-965a-05250fb8492e" acquired by "delete_volume" :: waited 0.033s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Deleted volume successfully. Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcb0fc7-aec8-481e-9723-73ff87a2608f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-37e38eab-3f65-4e1b-95af-7b577faad5f1 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-17ffd12b-4f0d-40a2-acb0-007854477ca1-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:48 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e Sep 01 12:46:48 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:48 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e" returned: 0 in 0.401s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:48 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e Sep 01 12:46:48 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:49 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-710df472-c495-4f9c-965a-05250fb8492e" returned: 0 in 0.283s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-710df472-c495-4f9c-965a-05250fb8492e" released by "delete_volume" :: held 0.761s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Created reservations ['c2fe84b8-ac47-48a5-a07c-3542b2ab978e', 'a108727b-dd52-40d8-aa8e-4ee30b1e994e', 'da42b743-48ef-4c05-9c21-841a4973d99c', 'af52df9c-11c6-405f-9ea7-54c586f86de8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:49 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:49 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-6b84907e-3fb7-4e32-98a5-e6b52181638e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "cinder-6b84907e-3fb7-4e32-98a5-e6b52181638e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:49 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Acquiring lock "cinder-quobyte-6b84907e-3fb7-4e32-98a5-e6b52181638e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:46:49 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Deleted volume successfully. Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-6b84907e-3fb7-4e32-98a5-e6b52181638e" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-30474ccd-3f6c-4545-8cd8-8db9526a62f2 tempest-VolumesTestJSON-1239076837 None] Lock "cinder-710df472-c495-4f9c-965a-05250fb8492e-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72ece8-03a4-47b7-8d9a-4ff047ad029f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:49 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e Sep 01 12:46:49 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:49 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e" returned: 0 in 0.468s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:50 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e Sep 01 12:46:50 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:50 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6b84907e-3fb7-4e32-98a5-e6b52181638e" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "cinder-quobyte-6b84907e-3fb7-4e32-98a5-e6b52181638e" released by "delete_volume" :: held 0.807s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Created reservations ['082a6e3e-4fe3-4df7-9227-034c46b4c04c', 'b7b05b78-3d49-4043-9384-9a6dd24768a9', 'a3ad0740-11f9-437c-9250-6af42b1d2754', '44df0d97-c43c-433c-9c31-d3d82ce60c3f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:50 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:46:50 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:50 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.390s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:46:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Deleted volume successfully. Sep 01 12:46:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-39bd0554-0c0a-4679-9d24-88f8cf495e5f tempest-VolumesTestJSON-1239076837 None] Lock "cinder-6b84907e-3fb7-4e32-98a5-e6b52181638e-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Flow 'volume_create_manager' (843acf36-90e9-4d4a-b09b-478e107749a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb9815b-7110-4afb-851f-08dcf9e63076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb9815b-7110-4afb-851f-08dcf9e63076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1734484271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b8ec3-609b-4c81-ae30-62337b7e4b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4387d94ff3fd444fab89a0629c17e826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:54Z,use_quota=True,user_id='3939f7b5a07640a0a43f8abfae7ad12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15e55f-9af6-4ba9-94d8-206615551402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15e55f-9af6-4ba9-94d8-206615551402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93574e44-568a-4c13-982e-9440e224d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93574e44-568a-4c13-982e-9440e224d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1b8ec3-609b-4c81-ae30-62337b7e4b59', 'volume_name': 'volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ebd8d8-b945-42a7-bfe5-fd2b76cc505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ebd8d8-b945-42a7-bfe5-fd2b76cc505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179e4e3a-c30b-4abf-8b78-fe389f8671c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Volume df1b8ec3-609b-4c81-ae30-62337b7e4b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59', 'volume_size': 1} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1734484271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b8ec3-609b-4c81-ae30-62337b7e4b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4387d94ff3fd444fab89a0629c17e826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:46:54Z,use_quota=True,user_id='3939f7b5a07640a0a43f8abfae7ad12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Creating volume df1b8ec3-609b-4c81-ae30-62337b7e4b59 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:46:54 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:54 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 1073741824 Sep 01 12:46:54 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:54 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 1073741824" returned: 0 in 0.570s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:46:54 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 Sep 01 12:46:54 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:46:55 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179e4e3a-c30b-4abf-8b78-fe389f8671c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aafbc6-9fcb-48f8-9fb1-44574c43c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:46:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Volume volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 (df1b8ec3-609b-4c81-ae30-62337b7e4b59): created successfully Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aafbc6-9fcb-48f8-9fb1-44574c43c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:46:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Flow 'volume_create_manager' (843acf36-90e9-4d4a-b09b-478e107749a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:46:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7050ce8f-dea4-4a47-98b4-26525113f4cf tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Created volume successfully. Sep 01 12:46:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-344e53af-4e2a-48e4-bc22-1ea32657e166 req-382d996b-9634-409c-a6c3-f50a2bf204be tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:46:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-344e53af-4e2a-48e4-bc22-1ea32657e166 req-382d996b-9634-409c-a6c3-f50a2bf204be tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:46:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-344e53af-4e2a-48e4-bc22-1ea32657e166 req-382d996b-9634-409c-a6c3-f50a2bf204be tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:46:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-344e53af-4e2a-48e4-bc22-1ea32657e166 req-382d996b-9634-409c-a6c3-f50a2bf204be tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8604d73-2957-42ab-9131-3c5460820c46', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:46:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-344e53af-4e2a-48e4-bc22-1ea32657e166 req-382d996b-9634-409c-a6c3-f50a2bf204be tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] attachment_update completed successfully. Sep 01 12:47:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-93e80421-aada-47ad-8a6a-29875ff44afd req-b96bf5cc-f009-46f7-9cd4-c90218c4d42f tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Terminate volume connection completed successfully. Sep 01 12:47:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-93e80421-aada-47ad-8a6a-29875ff44afd req-b96bf5cc-f009-46f7-9cd4-c90218c4d42f tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Deleting attachment a8604d73-2957-42ab-9131-3c5460820c46. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "cinder-df1b8ec3-609b-4c81-ae30-62337b7e4b59-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "cinder-df1b8ec3-609b-4c81-ae30-62337b7e4b59-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "cinder-quobyte-df1b8ec3-609b-4c81-ae30-62337b7e4b59" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "cinder-quobyte-df1b8ec3-609b-4c81-ae30-62337b7e4b59" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db9fd0-e066-49ee-b4f3-033521c04895]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:01 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 Sep 01 12:47:01 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-18702994-cc89-4ee1-a650-d154de84f33e tempest-GroupsV320Test-188229174 None] Group tempest-GroupsV320Test-Group-329576604: creating Sep 01 12:47:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-18702994-cc89-4ee1-a650-d154de84f33e tempest-GroupsV320Test-188229174 None] Group tempest-GroupsV320Test-Group-329576604: created successfully Sep 01 12:47:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-18702994-cc89-4ee1-a650-d154de84f33e tempest-GroupsV320Test-188229174 None] Create group completed successfully. Sep 01 12:47:02 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59" returned: 0 in 0.458s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:02 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59 Sep 01 12:47:02 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:02 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-df1b8ec3-609b-4c81-ae30-62337b7e4b59" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "cinder-quobyte-df1b8ec3-609b-4c81-ae30-62337b7e4b59" released by "delete_volume" :: held 0.768s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Created reservations ['cb1b0643-b66f-4458-9bf1-b02ce95ed470', '295b7170-4c55-41c5-a642-c960b37dd42f', '5b8a747c-c3b3-4669-a780-034a748bd293', 'db376abd-0ecf-42d4-a35e-f1924f4faff8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:02 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:02 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:03 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:03 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Deleted volume successfully. Sep 01 12:47:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1f0893ce-7399-40ec-8285-efb0f9639f04 tempest-TestServerVolumeAttachScenarioOldVersion-1012562332 None] Lock "cinder-df1b8ec3-609b-4c81-ae30-62337b7e4b59-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Created reservations ['86f406b7-65f0-41f3-8e65-52da21b6c99e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:04 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:04 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:04 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:04 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-16590b1b-31f6-4107-b2b0-7c0367556d27 tempest-GroupsV320Test-188229174 None] Delete group completed successfully. Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=80,cinder:INSERT=25,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=73,cinder:UPDATE=96,cinder:DELETE=9,cinder:INSERT=20 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Flow 'volume_create_manager' (b1ce040c-05ea-4862-acb6-cfca42a1997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47976d9-2f21-4485-bcf6-e07fa23d2189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47976d9-2f21-4485-bcf6-e07fa23d2189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1566108526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970373ff-020e-477b-a6f9-a4e5c708535f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f36a2fceae244e694504312e73483b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:14Z,use_quota=True,user_id='45a9bcc038714466aab6d49b71cd8011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523f42f-d387-445e-a398-d27abc0bf295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523f42f-d387-445e-a398-d27abc0bf295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e9c8b0-d4cd-48f9-b9f3-606363465ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e9c8b0-d4cd-48f9-b9f3-606363465ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970373ff-020e-477b-a6f9-a4e5c708535f', 'volume_name': 'volume-970373ff-020e-477b-a6f9-a4e5c708535f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8962c2a-5fd3-49a9-8056-6e61b64083d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8962c2a-5fd3-49a9-8056-6e61b64083d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336e25d8-743a-4bb9-b946-1b2b4d92f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:14 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Volume 970373ff-020e-477b-a6f9-a4e5c708535f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970373ff-020e-477b-a6f9-a4e5c708535f', 'volume_size': 1} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1566108526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970373ff-020e-477b-a6f9-a4e5c708535f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f36a2fceae244e694504312e73483b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:14Z,use_quota=True,user_id='45a9bcc038714466aab6d49b71cd8011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Creating volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:14 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:14 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f 1073741824 Sep 01 12:47:14 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:15 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f 1073741824" returned: 0 in 0.624s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:15 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f Sep 01 12:47:15 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:15 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f" returned: 0 in 0.359s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336e25d8-743a-4bb9-b946-1b2b4d92f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970373ff-020e-477b-a6f9-a4e5c708535f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b39142d-3e8c-4f1d-811c-8c095e90fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Volume volume-970373ff-020e-477b-a6f9-a4e5c708535f (970373ff-020e-477b-a6f9-a4e5c708535f): created successfully Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b39142d-3e8c-4f1d-811c-8c095e90fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Flow 'volume_create_manager' (b1ce040c-05ea-4862-acb6-cfca42a1997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4b780165-2d20-481c-b9a1-fe87c8dc4bb2 tempest-SnapshotsActionsTest-389319103 None] Created volume successfully. Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (a74d14df-4e8c-41de-92df-a3230bb2fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36085b65-c555-4916-b9c1-b2b84e15de41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36085b65-c555-4916-b9c1-b2b84e15de41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-681119733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80fa4e1-fa03-421d-9e8d-3529f6bb952d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:16Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c716404-60de-48ab-b783-f5b003a95287),volume_type_id=6c716404-60de-48ab-b783-f5b003a95287)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509e3cf-20de-412d-bcc1-63733250f943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509e3cf-20de-412d-bcc1-63733250f943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b6168-e820-4ec0-a54f-1b80c8695579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b6168-e820-4ec0-a54f-1b80c8695579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80fa4e1-fa03-421d-9e8d-3529f6bb952d', 'volume_name': 'volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144aff15-3cf5-4bfc-9b3f-a0b83f923ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144aff15-3cf5-4bfc-9b3f-a0b83f923ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02883a9e-0548-4b10-bddf-3bfc07b0d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:15 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume b80fa4e1-fa03-421d-9e8d-3529f6bb952d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d', 'volume_size': 1} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-681119733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80fa4e1-fa03-421d-9e8d-3529f6bb952d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:16Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c716404-60de-48ab-b783-f5b003a95287),volume_type_id=6c716404-60de-48ab-b783-f5b003a95287)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Creating volume b80fa4e1-fa03-421d-9e8d-3529f6bb952d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:15 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:15 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d 1073741824 Sep 01 12:47:15 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (27c53c68-40fd-46c2-96bd-b4bab9f60e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8353bd-ab5e-4f75-b4cb-f24346b70605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8353bd-ab5e-4f75-b4cb-f24346b70605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1026592214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f9f5f-6866-4175-9881-153b91315713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:16Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e57c759-4c54-4b72-8e3f-7e4a3153d130),volume_type_id=5e57c759-4c54-4b72-8e3f-7e4a3153d130)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d18db-3294-4f45-8894-f2a63b9f9be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d18db-3294-4f45-8894-f2a63b9f9be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd88b3-a346-4ae8-9295-e7ae4d099853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd88b3-a346-4ae8-9295-e7ae4d099853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5f9f5f-6866-4175-9881-153b91315713', 'volume_name': 'volume-3b5f9f5f-6866-4175-9881-153b91315713', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073fd457-2efe-4b40-a439-94ec2d1adeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073fd457-2efe-4b40-a439-94ec2d1adeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b4f30-e038-4df0-abf4-b7678280c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume 3b5f9f5f-6866-4175-9881-153b91315713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5f9f5f-6866-4175-9881-153b91315713', 'volume_size': 1} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:16 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d 1073741824" returned: 0 in 0.613s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:16 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d Sep 01 12:47:16 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:16 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" returned: 0 in 0.393s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1026592214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5f9f5f-6866-4175-9881-153b91315713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:16Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e57c759-4c54-4b72-8e3f-7e4a3153d130),volume_type_id=5e57c759-4c54-4b72-8e3f-7e4a3153d130)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Creating volume 3b5f9f5f-6866-4175-9881-153b91315713 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:16 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:16 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 1073741824 Sep 01 12:47:16 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02883a9e-0548-4b10-bddf-3bfc07b0d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cc1f39-b603-48cb-bfbf-0398f65d51f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d (b80fa4e1-fa03-421d-9e8d-3529f6bb952d): created successfully Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cc1f39-b603-48cb-bfbf-0398f65d51f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (a74d14df-4e8c-41de-92df-a3230bb2fe59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7fa2c294-6cd0-4e10-b722-0928242b1676 tempest-TestInstancesWithCinderVolumes-305003084 None] Created volume successfully. Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (008a887b-7bf3-40b1-b0c5-aa52e01ab4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ea0ef-b0b2-4a63-becf-a34753a6d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ea0ef-b0b2-4a63-becf-a34753a6d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1917593250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591a441c-56b2-4259-b751-0f1be6b971cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:17Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb0c81f7-3a99-4423-9b5d-4affc229fdbb),volume_type_id=bb0c81f7-3a99-4423-9b5d-4affc229fdbb)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2195fb-bfd0-41e2-9fd7-d9ec7e47c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2195fb-bfd0-41e2-9fd7-d9ec7e47c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4511bf7-0d3f-4a0d-86fd-9f3cb73e9a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:47:17 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4511bf7-0d3f-4a0d-86fd-9f3cb73e9a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '591a441c-56b2-4259-b751-0f1be6b971cc', 'volume_name': 'volume-591a441c-56b2-4259-b751-0f1be6b971cc', 'volume_size': 1, 'image_id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--473727315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'daacd5ac11d44385a1b3d6b3f665bc73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'created_at': datetime.datetime(2026, 9, 1, 10, 47, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0c5a10-4c76-4efc-bcc5-79019223647a/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c8d1b8-fe99-4f30-9ca6-4457777c9613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c8d1b8-fe99-4f30-9ca6-4457777c9613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8279028-bef5-41e8-aeda-bd301c445502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Volume 591a441c-56b2-4259-b751-0f1be6b971cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-591a441c-56b2-4259-b751-0f1be6b971cc', 'volume_size': 1, 'image_id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--473727315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'daacd5ac11d44385a1b3d6b3f665bc73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'created_at': datetime.datetime(2026, 9, 1, 10, 47, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0c5a10-4c76-4efc-bcc5-79019223647a/file', 'properties': {}}, 'image_service': } Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Trying to clone 591a441c-56b2-4259-b751-0f1be6b971cc from image fa0c5a10-4c76-4efc-bcc5-79019223647a at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 1073741824" returned: 0 in 0.606s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:17 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 Sep 01 12:47:17 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:17 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713" returned: 0 in 0.303s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.048s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b4f30-e038-4df0-abf4-b7678280c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5f9f5f-6866-4175-9881-153b91315713', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab17b10-c245-445b-afb9-a5fa44bb522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Creating offline snapshot 1104ad74-8b89-454a-86e9-77d21dd0f590 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Volume volume-3b5f9f5f-6866-4175-9881-153b91315713 (3b5f9f5f-6866-4175-9881-153b91315713): created successfully Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab17b10-c245-445b-afb9-a5fa44bb522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (27c53c68-40fd-46c2-96bd-b4bab9f60e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487c1ec-8fc6-4c8d-a050-ead58a3cc3a9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-44757fc3-9c33-456f-98ca-e6c5de5a7b60 tempest-TestInstancesWithCinderVolumes-305003084 None] Created volume successfully. Sep 01 12:47:18 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f Sep 01 12:47:18 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:18 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:18 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 1G Sep 01 12:47:18 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:18 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 1G" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:18 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:18 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:19 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:19 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 is being set with open permissions: ugo+rw Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:19 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:19 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:19 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:19 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info Sep 01 12:47:19 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:19 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info" returned: 0 in 0.293s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:19 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info is being set with open permissions: ugo+rw Sep 01 12:47:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:19 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info Sep 01 12:47:19 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:20 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.info" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-816c4e00-4d6d-4e9f-af8e-79ce5162457d tempest-SnapshotsActionsTest-389319103 None] Create snapshot completed successfully Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD, size 20.69 MB, duration 3.86 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:47:21 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Image download 20.69 MB at 5.36 MB/s Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959fa84-6f54-4461-9243-c2068a427573]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:21 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD Sep 01 12:47:21 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:21 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Temporary image fa0c5a10-4c76-4efc-bcc5-79019223647a is fetched for user 944702e9221a4244ba85dec104dcaaba. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Creating offline snapshot 3547ba0d-31fd-458b-8c41-d4b4d23a640e of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8640a77d-25fb-49f3-915a-e6f3996f7c94]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[68300e2b-acbf-46b6-8aea-6e9e80f79828]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:22 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD Sep 01 12:47:22 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:22 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:22 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:22 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:22 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.398s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:22 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e 1G Sep 01 12:47:22 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:22 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e 1G" returned: 0 in 0.451s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:22 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e Sep 01 12:47:22 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:23 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:23 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e is being set with open permissions: ugo+rw Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:23 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e Sep 01 12:47:23 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:23 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.536s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1917593250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591a441c-56b2-4259-b751-0f1be6b971cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daacd5ac11d44385a1b3d6b3f665bc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:17Z,use_quota=True,user_id='944702e9221a4244ba85dec104dcaaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb0c81f7-3a99-4423-9b5d-4affc229fdbb),volume_type_id=bb0c81f7-3a99-4423-9b5d-4affc229fdbb)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Creating volume 591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:23 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:23 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1073741824 Sep 01 12:47:23 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-dbca5c4b-b46e-4d81-95d1-1b6a4b77d1e3 tempest-SnapshotsActionsTest-389319103 None] Create snapshot completed successfully Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (927f6298-0c11-4c31-bb02-99b146bd7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce1b67a-5847-4bcb-9f10-e35406c402fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce1b67a-5847-4bcb-9f10-e35406c402fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912883548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1693c-7451-4a4b-88b5-254aa7b6be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:24Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5f507d-3bbe-4ef5-95d6-4089a307fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5f507d-3bbe-4ef5-95d6-4089a307fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1498dbec-d521-41df-81a9-da15298513a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1498dbec-d521-41df-81a9-da15298513a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae1693c-7451-4a4b-88b5-254aa7b6be82', 'volume_name': 'volume-bae1693c-7451-4a4b-88b5-254aa7b6be82', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec61649-39c8-4665-961d-195c6a01fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec61649-39c8-4665-961d-195c6a01fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb5744c-b623-4012-b627-5257f8ed68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume bae1693c-7451-4a4b-88b5-254aa7b6be82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae1693c-7451-4a4b-88b5-254aa7b6be82', 'volume_size': 1} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:23 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1073741824" returned: 0 in 0.471s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc Sep 01 12:47:24 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-3547ba0d-31fd-458b-8c41-d4b4d23a640e-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-3547ba0d-31fd-458b-8c41-d4b4d23a640e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-3547ba0d-31fd-458b-8c41-d4b4d23a640e" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-3547ba0d-31fd-458b-8c41-d4b4d23a640e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Deleting offline snapshot 3547ba0d-31fd-458b-8c41-d4b4d23a640e of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:24 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] snapshot_file for this snap is: volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc" returned: 0 in 0.244s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912883548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1693c-7451-4a4b-88b5-254aa7b6be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:24Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[10182f6b-713f-4269-8208-8385ac6621c8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 1073741824 Sep 01 12:47:24 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Attempting download of fa0c5a10-4c76-4efc-bcc5-79019223647a ((None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}])) to volume 591a441c-56b2-4259-b751-0f1be6b971cc. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f3965-5bdb-4aed-9ab1-0ad4a8114ab4]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e Sep 01 12:47:24 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh Sep 01 12:47:24 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e" returned: 0 in 0.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b00b48-d1ff-4c8c-a07b-3636273da59a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 1073741824" returned: 0 in 0.505s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:24 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 Sep 01 12:47:24 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:24 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:24 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh Sep 01 12:47:24 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:25 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb5744c-b623-4012-b627-5257f8ed68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae1693c-7451-4a4b-88b5-254aa7b6be82', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dbeb6b-b0d3-4da0-8762-7a5de201a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:25 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 (bae1693c-7451-4a4b-88b5-254aa7b6be82): created successfully Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dbeb6b-b0d3-4da0-8762-7a5de201a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:25 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (927f6298-0c11-4c31-bb02-99b146bd7b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:25 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.380s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh" returned: 1 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa0c5a10-4c76-4efc-bcc5-79019223647a_i_en3frh' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0606e4b-9a1c-4f43-8ee6-4e2ca3c7f05f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:25 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e Sep 01 12:47:25 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0f494b91-b0fa-431a-85e5-7bbe34ad2b92 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:25 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD Sep 01 12:47:25 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:25 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] fa0c5a10-4c76-4efc-bcc5-79019223647a was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:25 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc Sep 01 12:47:25 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:25 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e" returned: 0 in 0.399s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:25 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e Sep 01 12:47:25 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:25 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.3547ba0d-31fd-458b-8c41-d4b4d23a640e" returned: 0 in 0.265s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-3547ba0d-31fd-458b-8c41-d4b4d23a640e" released by "_delete_snapshot" :: held 1.605s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_snapshot" :: held 1.631s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Created reservations ['fa51ec67-dbbe-47ba-8c98-f808805daafb', 'e269a44c-6804-4a50-a422-261af3cba8e3', '6a3a0c0e-4c8f-4bbb-a236-f922349616bc', '46522c22-a7d6-4310-b563-05fbfd995da7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Delete snapshot completed successfully. Sep 01 12:47:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5bb2de53-8883-4392-a313-de27506b01a5 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-3547ba0d-31fd-458b-8c41-d4b4d23a640e-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating offline snapshot dc1c3f91-1572-49f0-a4f1-e7c089b88838 of volume bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ccee39-a1e6-4ae4-ab59-32e2e80065b4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:26 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 Sep 01 12:47:26 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:26 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:26 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 1G Sep 01 12:47:26 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:26 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:26 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:26 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.328s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:47:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:47:27 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 1G" returned: 0 in 0.573s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:27 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 Sep 01 12:47:27 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:27 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc" returned: 0 in 1.902s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa0c5a10-4c76-4efc-bcc5-79019223647a_q8b89mypdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:47:27 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Converted 112.00 MB image at 58.83 MB/s Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:27 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1G Sep 01 12:47:27 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:27 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838" returned: 0 in 0.297s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:27 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 is being set with open permissions: ugo+rw Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:27 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 Sep 01 12:47:27 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:27 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838" returned: 0 in 0.246s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:27 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc 1G" returned: 0 in 0.303s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Downloaded image fa0c5a10-4c76-4efc-bcc5-79019223647a ((None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}])) to volume 591a441c-56b2-4259-b751-0f1be6b971cc successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Temporary image fa0c5a10-4c76-4efc-bcc5-79019223647a for user 944702e9221a4244ba85dec104dcaaba is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Marking volume 591a441c-56b2-4259-b751-0f1be6b971cc as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Copying metadata from image fa0c5a10-4c76-4efc-bcc5-79019223647a to 591a441c-56b2-4259-b751-0f1be6b971cc. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Creating volume glance metadata for volume 591a441c-56b2-4259-b751-0f1be6b971cc backed by image fa0c5a10-4c76-4efc-bcc5-79019223647a with: {'image_id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'image_name': 'tempest-scenario-img--473727315', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:27 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info Sep 01 12:47:27 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8279028-bef5-41e8-aeda-bd301c445502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591a441c-56b2-4259-b751-0f1be6b971cc', 'volume_size': 1, 'image_id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa0c5a10-4c76-4efc-bcc5-79019223647a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--473727315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'daacd5ac11d44385a1b3d6b3f665bc73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa0c5a10-4c76-4efc-bcc5-79019223647a', 'created_at': datetime.datetime(2026, 9, 1, 10, 47, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa0c5a10-4c76-4efc-bcc5-79019223647a/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d84401f-5ce5-4905-aff0-25fc42a7a06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:27 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Volume volume-591a441c-56b2-4259-b751-0f1be6b971cc (591a441c-56b2-4259-b751-0f1be6b971cc): created successfully Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d84401f-5ce5-4905-aff0-25fc42a7a06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Flow 'volume_create_manager' (008a887b-7bf3-40b1-b0c5-aa52e01ab4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-349ffa47-a312-424a-81fe-b4a82790ef9f tempest-TestInstancesWithCinderVolumes-305003084 None] Created volume successfully. Sep 01 12:47:28 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:28 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info is being set with open permissions: ugo+rw Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:28 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info Sep 01 12:47:28 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:28 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.info" returned: 0 in 0.243s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.535s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Creating offline snapshot 223c931c-ab05-4008-af9d-9739ae8d61f9 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cf5d9275-d1fc-45d5-9089-093cd5e46496 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Create snapshot completed successfully Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcf74c3-abd3-4082-a50d-2a9a2e7b026f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:28 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:28 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:28 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:28 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 1G Sep 01 12:47:28 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:29 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 1G" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:29 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 Sep 01 12:47:29 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:29 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9" returned: 0 in 0.326s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:29 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 is being set with open permissions: ugo+rw Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:29 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 Sep 01 12:47:29 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:29 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (b888b588-1384-4f3b-a6ac-4f219d537b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1a48f3-8ea7-418b-a266-6216fd79c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1a48f3-8ea7-418b-a266-6216fd79c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462410294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:30Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f440c5ba-39e4-49dc-ae6b-02483fa18836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f440c5ba-39e4-49dc-ae6b-02483fa18836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc1ce21-9d71-4068-bf89-07296ac05952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc1ce21-9d71-4068-bf89-07296ac05952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f', 'volume_name': 'volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb5cc11-08f1-48e3-ab90-17919df1cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb5cc11-08f1-48e3-ab90-17919df1cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a04a01c-a472-42b6-9988-153bf2138b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f', 'volume_size': 1} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.675s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462410294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:30Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:29 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:30 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f 1073741824 Sep 01 12:47:30 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e30a3c23-681c-4171-8099-278cfba11122 tempest-SnapshotsActionsTest-389319103 None] Create snapshot completed successfully Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (c0a28101-9a64-4013-bc9d-30b3c331d196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d8aed8-48b9-4bda-988a-a11250fdfd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d8aed8-48b9-4bda-988a-a11250fdfd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852978461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602d5e5f-2c87-453a-81fe-666b15d38fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:30Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebb5bab-3fb3-44f6-b7c0-60a0e5a1ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebb5bab-3fb3-44f6-b7c0-60a0e5a1ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fd8a73-4dcc-43dc-92c4-4bd15a609daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fd8a73-4dcc-43dc-92c4-4bd15a609daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602d5e5f-2c87-453a-81fe-666b15d38fda', 'volume_name': 'volume-602d5e5f-2c87-453a-81fe-666b15d38fda', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968338ba-a38a-4428-b147-962481651cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968338ba-a38a-4428-b147-962481651cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba878299-9352-4d40-9f5d-aebcdb0e16df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume 602d5e5f-2c87-453a-81fe-666b15d38fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602d5e5f-2c87-453a-81fe-666b15d38fda', 'volume_size': 1} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:30 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f 1073741824" returned: 0 in 0.659s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (a8446389-7b80-4fd2-93bb-4698b1cc6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5af2a5-b312-4c21-9529-26fa8a4931c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:30 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f Sep 01 12:47:30 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5af2a5-b312-4c21-9529-26fa8a4931c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395370030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17097b29-a2ae-4b66-a93a-17224212f87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:31Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afe95bd-4e95-4a5f-b7f4-b4cf95978557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afe95bd-4e95-4a5f-b7f4-b4cf95978557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5493c754-697c-4b43-967a-91560db50429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5493c754-697c-4b43-967a-91560db50429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17097b29-a2ae-4b66-a93a-17224212f87d', 'volume_name': 'volume-17097b29-a2ae-4b66-a93a-17224212f87d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2c7db7-3b4a-4b89-bdd0-bfd547a40c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2c7db7-3b4a-4b89-bdd0-bfd547a40c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c811ae-d6e2-48a0-bb48-185ade169fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume 17097b29-a2ae-4b66-a93a-17224212f87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17097b29-a2ae-4b66-a93a-17224212f87d', 'volume_size': 1} Sep 01 12:47:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-223c931c-ab05-4008-af9d-9739ae8d61f9-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-223c931c-ab05-4008-af9d-9739ae8d61f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:31 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" returned: 0 in 0.384s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-223c931c-ab05-4008-af9d-9739ae8d61f9" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852978461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602d5e5f-2c87-453a-81fe-666b15d38fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:30Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume 602d5e5f-2c87-453a-81fe-666b15d38fda {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:31 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:31 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda 1073741824 Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a04a01c-a472-42b6-9988-153bf2138b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c892da-f045-4920-ba67-02c45283a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-223c931c-ab05-4008-af9d-9739ae8d61f9" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Deleting offline snapshot 223c931c-ab05-4008-af9d-9739ae8d61f9 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] snapshot_file for this snap is: volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b486b80-951b-43a1-9f33-1fd5acaf4dd0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f (a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f): created successfully Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c892da-f045-4920-ba67-02c45283a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (b888b588-1384-4f3b-a6ac-4f219d537b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7b1f7b2c-6620-4b29-a77e-9bff15e3c661 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (36999075-b01b-4cdd-afaa-4ba6c77cd792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd188b9d-4d14-41c2-a824-2fb3cd326769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd188b9d-4d14-41c2-a824-2fb3cd326769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941731815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4398f174-0424-43a9-b085-d5400252bb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:31Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e002dbcc-7ee7-4180-87c1-31f746b681ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e002dbcc-7ee7-4180-87c1-31f746b681ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0943e9-d22d-4512-bd83-8c66e15d3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0943e9-d22d-4512-bd83-8c66e15d3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4398f174-0424-43a9-b085-d5400252bb33', 'volume_name': 'volume-4398f174-0424-43a9-b085-d5400252bb33', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 Sep 01 12:47:31 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ea50b9-ad5e-47f3-a2ae-01b59f1607b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ea50b9-ad5e-47f3-a2ae-01b59f1607b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0853fed9-e3c9-4182-8dd7-0d9df1c6bcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume 4398f174-0424-43a9-b085-d5400252bb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4398f174-0424-43a9-b085-d5400252bb33', 'volume_size': 1} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:31 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9" returned: 0 in 0.607s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:31 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda 1073741824" returned: 0 in 0.795s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c9ef6d-9a34-4c09-b5d6-decfc297f6f4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:32 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda Sep 01 12:47:32 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (af9a3ff0-77a4-441c-b535-b72e9fae61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673f268d-a634-405b-bccb-7382987798cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673f268d-a634-405b-bccb-7382987798cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276478143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da61283-7fdd-460e-91ca-8b9b71f80c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:32Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cc636-be2d-4b55-af04-146624124136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cc636-be2d-4b55-af04-146624124136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feab065-bf23-42c6-9b86-7f51ea61188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:32 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feab065-bf23-42c6-9b86-7f51ea61188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da61283-7fdd-460e-91ca-8b9b71f80c3c', 'volume_name': 'volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f3800a-a13f-4127-b352-1ebfbcc2e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f3800a-a13f-4127-b352-1ebfbcc2e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956e1a96-c601-41e3-918d-067b26c963dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume 8da61283-7fdd-460e-91ca-8b9b71f80c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c', 'volume_size': 1} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:32 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda" returned: 0 in 0.375s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395370030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17097b29-a2ae-4b66-a93a-17224212f87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:31Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume 17097b29-a2ae-4b66-a93a-17224212f87d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:32 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:32 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d 1073741824 Sep 01 12:47:32 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba878299-9352-4d40-9f5d-aebcdb0e16df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602d5e5f-2c87-453a-81fe-666b15d38fda', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fad5230-ddc1-416d-9e27-98f149b0065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-602d5e5f-2c87-453a-81fe-666b15d38fda (602d5e5f-2c87-453a-81fe-666b15d38fda): created successfully Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fad5230-ddc1-416d-9e27-98f149b0065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (c0a28101-9a64-4013-bc9d-30b3c331d196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:32 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-93213040-1702-405c-a708-752888749831 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.631s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:32 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 Sep 01 12:47:32 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fa5c7579-464f-4754-bc3b-205b16e800ff req-8f4573ec-0938-415d-bbc0-c44299a80ba6 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:33 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d 1073741824" returned: 0 in 0.582s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:33 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d Sep 01 12:47:33 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:33 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9" returned: 0 in 0.564s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:33 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9 Sep 01 12:47:33 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:33 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d" returned: 0 in 0.359s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941731815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4398f174-0424-43a9-b085-d5400252bb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:31Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume 4398f174-0424-43a9-b085-d5400252bb33 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:33 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c811ae-d6e2-48a0-bb48-185ade169fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17097b29-a2ae-4b66-a93a-17224212f87d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e95763e-46c4-46d8-acf7-73bd3829f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:33 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 1073741824 Sep 01 12:47:33 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:33 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-17097b29-a2ae-4b66-a93a-17224212f87d (17097b29-a2ae-4b66-a93a-17224212f87d): created successfully Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e95763e-46c4-46d8-acf7-73bd3829f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (a8446389-7b80-4fd2-93bb-4698b1cc6a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-77a771b1-a87c-484c-9e83-db150dbe828a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:33 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.223c931c-ab05-4008-af9d-9739ae8d61f9" returned: 0 in 0.384s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-223c931c-ab05-4008-af9d-9739ae8d61f9" released by "_delete_snapshot" :: held 2.372s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_snapshot" :: held 2.455s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Created reservations ['de44219b-441e-47b3-b604-ec8f0f6ba99f', '5bf4a4cd-a8b7-4417-9c1c-b0ac9b8fc993', '4acc8b8a-a317-4f80-b0ce-44d959cee680', '5fb61d5d-a9ab-4343-92f8-df7b6ce14df3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Delete snapshot completed successfully. Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8c3ecd0f-4ed8-40ba-9834-9bf127198ac2 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-223c931c-ab05-4008-af9d-9739ae8d61f9-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:33 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 1073741824" returned: 0 in 0.486s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:34 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 Sep 01 12:47:34 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:34 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276478143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da61283-7fdd-460e-91ca-8b9b71f80c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e1dd5402484143be060a49d01ea743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:32Z,use_quota=True,user_id='1550b65a0d974e6588251a8ddae85093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Creating volume 8da61283-7fdd-460e-91ca-8b9b71f80c3c {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:34 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0853fed9-e3c9-4182-8dd7-0d9df1c6bcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4398f174-0424-43a9-b085-d5400252bb33', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771a857-0ba0-4d4e-b557-a613576808b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:34 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c 1073741824 Sep 01 12:47:34 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-4398f174-0424-43a9-b085-d5400252bb33 (4398f174-0424-43a9-b085-d5400252bb33): created successfully Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771a857-0ba0-4d4e-b557-a613576808b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (36999075-b01b-4cdd-afaa-4ba6c77cd792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1cdde5e6-a8fc-4b0b-ae76-61b76c09a1f8 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:34 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c 1073741824" returned: 0 in 0.621s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:34 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c Sep 01 12:47:34 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:35 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fa5c7579-464f-4754-bc3b-205b16e800ff req-8f4573ec-0938-415d-bbc0-c44299a80ba6 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.514s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956e1a96-c601-41e3-918d-067b26c963dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f430ff2-6e23-4025-a73b-9063a5cd530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fa5c7579-464f-4754-bc3b-205b16e800ff req-8f4573ec-0938-415d-bbc0-c44299a80ba6 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.428s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Volume volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c (8da61283-7fdd-460e-91ca-8b9b71f80c3c): created successfully Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f430ff2-6e23-4025-a73b-9063a5cd530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Flow 'volume_create_manager' (af9a3ff0-77a4-441c-b535-b72e9fae61e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Creating offline snapshot cdfe646d-59e3-4afc-bd6d-66586237e877 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6bc4acb1-1674-40a0-84f8-0d152b7f400c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created volume successfully. Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe1434-ecf9-42c5-80a7-a9dcd74a5189]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-fa5c7579-464f-4754-bc3b-205b16e800ff req-8f4573ec-0938-415d-bbc0-c44299a80ba6 tempest-TestInstancesWithCinderVolumes-305003084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-591a441c-56b2-4259-b751-0f1be6b971cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ff0d92a-1db1-4f67-8db1-5d5024e3a50d', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:47:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-fa5c7579-464f-4754-bc3b-205b16e800ff req-8f4573ec-0938-415d-bbc0-c44299a80ba6 tempest-TestInstancesWithCinderVolumes-305003084 None] attachment_update completed successfully. Sep 01 12:47:35 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:35 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-8da61283-7fdd-460e-91ca-8b9b71f80c3c-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-8da61283-7fdd-460e-91ca-8b9b71f80c3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-8da61283-7fdd-460e-91ca-8b9b71f80c3c" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-8da61283-7fdd-460e-91ca-8b9b71f80c3c" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cdbf2-1193-4ab1-addf-43f896a62cf6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:35 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c Sep 01 12:47:35 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:35 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.546s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:35 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 1G Sep 01 12:47:35 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c" returned: 0 in 0.459s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:36 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:36 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c Sep 01 12:47:36 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:36 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8da61283-7fdd-460e-91ca-8b9b71f80c3c" returned: 0 in 0.521s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-8da61283-7fdd-460e-91ca-8b9b71f80c3c" released by "delete_volume" :: held 1.059s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:36 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 1G" returned: 0 in 0.962s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:36 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['cc95d3a3-8ebc-443c-a5dc-24af67861c34', 'a7839f54-e732-4c94-aa74-0a3fe8612fc1', '70ad0236-4a2b-4d57-8b83-199760261044', '2c58eb5f-6dd5-44b3-824b-75e6925fab13'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:36 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 Sep 01 12:47:36 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:37 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:37 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:37 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877" returned: 0 in 0.518s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 is being set with open permissions: ugo+rw Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:37 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 Sep 01 12:47:37 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:37 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b2f64ac1-630b-4837-8d96-cf070b33addb tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-8da61283-7fdd-460e-91ca-8b9b71f80c3c-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:37 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-01e1cd73-1889-4f41-a01a-941935091b35 tempest-SnapshotsActionsTest-389319103 None] Create snapshot completed successfully Sep 01 12:47:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-4398f174-0424-43a9-b085-d5400252bb33-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-4398f174-0424-43a9-b085-d5400252bb33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-4398f174-0424-43a9-b085-d5400252bb33" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-4398f174-0424-43a9-b085-d5400252bb33" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c01dc2c-4490-42cf-8387-27fef8edd260]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-cdfe646d-59e3-4afc-bd6d-66586237e877-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-cdfe646d-59e3-4afc-bd6d-66586237e877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-cdfe646d-59e3-4afc-bd6d-66586237e877" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-cdfe646d-59e3-4afc-bd6d-66586237e877" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Deleting offline snapshot cdfe646d-59e3-4afc-bd6d-66586237e877 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] snapshot_file for this snap is: volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[495075c2-c211-41b2-9985-aec16ebe99c1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:38 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 Sep 01 12:47:38 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:38 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 Sep 01 12:47:38 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:38 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33" returned: 0 in 0.591s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:38 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33 Sep 01 12:47:38 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:38 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877" returned: 0 in 0.622s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbd6ec4-e9d6-4a34-99d1-c5e9ec04b3a5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:39 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4398f174-0424-43a9-b085-d5400252bb33" returned: 0 in 0.362s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-4398f174-0424-43a9-b085-d5400252bb33" released by "delete_volume" :: held 1.025s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:39 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:39 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['a83f32fd-68c8-4efc-8700-806aff7509ee', 'de812e69-dc1e-4e64-953b-ee516274aec6', '32d9bedb-c90b-4f13-b95b-30654c3f9a4c', '9403e697-4664-4092-8b49-cfa5798c0d30'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:39 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:39 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:39 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.640s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:39 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 Sep 01 12:47:39 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:39 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7d37a8d-d2c0-4f20-9276-475ed66fdb07 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-4398f174-0424-43a9-b085-d5400252bb33-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:40 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877" returned: 0 in 0.510s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:40 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877 Sep 01 12:47:40 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-17097b29-a2ae-4b66-a93a-17224212f87d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-17097b29-a2ae-4b66-a93a-17224212f87d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:40 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.cdfe646d-59e3-4afc-bd6d-66586237e877" returned: 0 in 0.407s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-17097b29-a2ae-4b66-a93a-17224212f87d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-cdfe646d-59e3-4afc-bd6d-66586237e877" released by "_delete_snapshot" :: held 2.338s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-17097b29-a2ae-4b66-a93a-17224212f87d" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_snapshot" :: held 2.391s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31dc694-5004-4239-a5c3-50d28238e2d7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Created reservations ['ce3ef5e7-4a46-4706-8500-f012e2a8abb4', '9f15057d-c0d2-4ecc-b937-cbaf119f033d', '160d0e63-0028-4344-b76f-19cff0d4298b', 'fca75b48-540e-4789-baf5-1c5ae4c5d52b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Delete snapshot completed successfully. Sep 01 12:47:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8d6f6529-e423-4ad2-86f8-8814d90f4268 tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-cdfe646d-59e3-4afc-bd6d-66586237e877-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:40 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d Sep 01 12:47:40 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:41 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d" returned: 0 in 0.512s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:41 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d Sep 01 12:47:41 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:41 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17097b29-a2ae-4b66-a93a-17224212f87d" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-17097b29-a2ae-4b66-a93a-17224212f87d" released by "delete_volume" :: held 0.934s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['ab579ef3-ce98-4698-9fda-781531f60dd5', '1b083b08-df4f-43a5-bb1f-c1d531666505', '9b568c24-2aa3-43e3-974d-9e769a30a1f5', 'edec69d9-9ed1-4e65-98a6-85356246f841'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:41 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:41 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Creating offline snapshot 13233a0f-7cc1-4a44-973b-18ea174b54b9 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccdb13a-9ccf-438e-9638-88a12912bba2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:42 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.416s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e89a46-b5ec-40bf-bac7-ca4df0b50d4f tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-17097b29-a2ae-4b66-a93a-17224212f87d-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:42 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:42 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:42 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.590s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:42 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 1G Sep 01 12:47:42 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-602d5e5f-2c87-453a-81fe-666b15d38fda-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-602d5e5f-2c87-453a-81fe-666b15d38fda-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-602d5e5f-2c87-453a-81fe-666b15d38fda" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-602d5e5f-2c87-453a-81fe-666b15d38fda" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14b79c-93ee-4666-bcaa-fa63591cbf16]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:43 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda Sep 01 12:47:43 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:43 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 1G" returned: 0 in 1.062s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:43 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 Sep 01 12:47:43 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:44 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda" returned: 0 in 0.935s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:44 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda Sep 01 12:47:44 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:44 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9" returned: 0 in 0.550s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:44 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 is being set with open permissions: ugo+rw Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:44 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 Sep 01 12:47:44 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:44 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-602d5e5f-2c87-453a-81fe-666b15d38fda" returned: 0 in 0.466s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-602d5e5f-2c87-453a-81fe-666b15d38fda" released by "delete_volume" :: held 1.469s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['466c29c8-3c34-4ebd-9ef2-864490f73ee4', 'd671bd96-ee87-4a88-997e-266a00b40e48', '3566e3ff-f50b-4d6e-92ae-97725c4b002f', '64ae8302-9694-4fb8-9758-f87738655072'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:44 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:44 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:44 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9" returned: 0 in 0.354s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:44 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e2ad6e06-eeee-463d-8152-7faca90a5e2c tempest-SnapshotsActionsTest-389319103 None] Create snapshot completed successfully Sep 01 12:47:44 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-85bc95c6-ca15-48d7-83d0-1d42970ee78a tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-602d5e5f-2c87-453a-81fe-666b15d38fda-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-13233a0f-7cc1-4a44-973b-18ea174b54b9-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-13233a0f-7cc1-4a44-973b-18ea174b54b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Acquiring lock "cinder-quobyte-13233a0f-7cc1-4a44-973b-18ea174b54b9" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" acquired by "delete_volume" :: waited 0.053s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce7702-cea4-437a-9169-573c4ea6d92b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-13233a0f-7cc1-4a44-973b-18ea174b54b9" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Deleting offline snapshot 13233a0f-7cc1-4a44-973b-18ea174b54b9 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] snapshot_file for this snap is: volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20349e5-68e2-4550-a754-40bf10dbd72e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:45 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f Sep 01 12:47:45 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:45 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 Sep 01 12:47:45 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:46 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" returned: 0 in 0.447s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:46 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f Sep 01 12:47:46 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:46 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9" returned: 0 in 0.486s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffbdda-9b69-4406-878e-2d51536c584e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:46 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:46 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:46 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" returned: 0 in 0.317s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f" released by "delete_volume" :: held 0.829s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['91c0e239-5d61-477c-b78d-188afb71292c', '39b2f914-7fcc-4b46-8212-815828a592aa', 'c12ff9af-6539-44a1-9359-8842cc81ae65', 'c2037e02-39bf-44b1-8bf3-7b15a0cd0341'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:46 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:46 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-dc1c3f91-1572-49f0-a4f1-e7c089b88838-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:46 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.569s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-dc1c3f91-1572-49f0-a4f1-e7c089b88838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:46 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 Sep 01 12:47:46 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-dc1c3f91-1572-49f0-a4f1-e7c089b88838" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-dc1c3f91-1572-49f0-a4f1-e7c089b88838" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleting offline snapshot dc1c3f91-1572-49f0-a4f1-e7c089b88838 of volume bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] snapshot_file for this snap is: volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a34c9d-9383-4d4b-9a41-ad1c87032067]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:47 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.441s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-536e0c6c-2c32-4bf0-bb46-d3c8bdcad02c tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-a9c5f2af-36e6-443a-a1ae-c1b3d53ef28f-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:47 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 Sep 01 12:47:47 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:47 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9" returned: 0 in 0.627s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:47 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9 Sep 01 12:47:47 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:47 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838" returned: 0 in 0.648s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae1693c-7451-4a4b-88b5-254aa7b6be82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8959bd1-d75c-4281-b184-4e9b92c0edff]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:47 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.13233a0f-7cc1-4a44-973b-18ea174b54b9" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-13233a0f-7cc1-4a44-973b-18ea174b54b9" released by "_delete_snapshot" :: held 2.173s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_snapshot" :: held 2.245s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:47 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 Sep 01 12:47:47 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:47 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Created reservations ['2a7d014c-a127-43bc-a503-9fbc0cd3f7c4', '9e6626a6-26d1-4608-9d67-6d1b39ed0823', 'f8bec642-4f4a-44e9-bd9b-fe1636b2ac08', 'f411930b-fd3c-435d-bd48-ee62a6e9c00b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Delete snapshot completed successfully. Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-043fe64e-736c-4479-afcb-cedd8fac709a tempest-SnapshotsActionsTest-439078350 None] Lock "cinder-13233a0f-7cc1-4a44-973b-18ea174b54b9-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:48 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82" returned: 0 in 0.557s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:48 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 Sep 01 12:47:48 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:48 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838" returned: 0 in 0.373s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:48 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838 Sep 01 12:47:48 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:48 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82.dc1c3f91-1572-49f0-a4f1-e7c089b88838" returned: 0 in 0.283s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-dc1c3f91-1572-49f0-a4f1-e7c089b88838" released by "_delete_snapshot" :: held 2.071s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" released by "delete_snapshot" :: held 2.121s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['9ce7fab7-0300-4fb0-9f2b-3f59d5b3c2e8', 'f6432fe7-f48a-4ecc-9ce7-c97b6708488b', '3d440398-8414-4270-8946-1b7ba7efba08', '22cbf8b3-7d79-4694-a2fb-5051b69aa102'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:49 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Delete snapshot completed successfully. Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-88e7b82f-9a83-4c17-88c0-04061839e723 tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-dc1c3f91-1572-49f0-a4f1-e7c089b88838-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "cinder-1104ad74-8b89-454a-86e9-77d21dd0f590-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-1104ad74-8b89-454a-86e9-77d21dd0f590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "cinder-quobyte-1104ad74-8b89-454a-86e9-77d21dd0f590" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-1104ad74-8b89-454a-86e9-77d21dd0f590" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Deleting offline snapshot 1104ad74-8b89-454a-86e9-77d21dd0f590 of volume 970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] snapshot_file for this snap is: volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781d56a-4705-4d43-9aa4-8eba92710c05]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:49 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:49 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:49 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.387s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970373ff-020e-477b-a6f9-a4e5c708535f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a4213-51d5-46b3-8729-4e7449f93bdc]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:49 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f Sep 01 12:47:49 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-bae1693c-7451-4a4b-88b5-254aa7b6be82-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-bae1693c-7451-4a4b-88b5-254aa7b6be82-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130475a-630d-4c6d-abd6-ed969834fcd9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:50 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f" returned: 0 in 0.450s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:50 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:50 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:50 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 Sep 01 12:47:50 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:50 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:50 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:50 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590 Sep 01 12:47:50 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:50 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82 Sep 01 12:47:50 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:50 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-bae1693c-7451-4a4b-88b5-254aa7b6be82" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:50 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f.1104ad74-8b89-454a-86e9-77d21dd0f590" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-quobyte-bae1693c-7451-4a4b-88b5-254aa7b6be82" released by "delete_volume" :: held 0.732s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-1104ad74-8b89-454a-86e9-77d21dd0f590" released by "_delete_snapshot" :: held 1.615s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_snapshot" :: held 1.648s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Created reservations ['ecebd8bc-cc6a-45ff-8364-8d763378669b', 'c35e5003-d83a-4c06-b358-8a8892c12959', 'c1cb2a8b-9073-4248-8cb4-67e16e7607b1', '7685b5ad-a268-4a63-91f3-aaed97f25dbb'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:50 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Created reservations ['05a11d37-13e6-498b-8fc0-59b751224cec', '5e60f44b-a986-4a0c-8b4a-05836a404bdd', '31adb303-f2e9-4d21-b81b-fd423cdc33ef', '8b43263c-8087-490a-87fb-41be60a20e6e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:51 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:51 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Delete snapshot completed successfully. Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa348e06-c35e-43b0-9c61-2b6ebc07441d tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-1104ad74-8b89-454a-86e9-77d21dd0f590-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:51 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.309s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Deleted volume successfully. Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3b201e6-7d63-4ad0-a9b7-8b8b3dc4261b tempest-CreateVolumesFromSnapshotTest-1854251117 None] Lock "cinder-bae1693c-7451-4a4b-88b5-254aa7b6be82-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "cinder-970373ff-020e-477b-a6f9-a4e5c708535f-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-970373ff-020e-477b-a6f9-a4e5c708535f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e73df7-ed58-4a49-bd41-e0ec34c17893]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:51 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f Sep 01 12:47:51 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:52 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f" returned: 0 in 0.413s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:52 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f Sep 01 12:47:52 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:52 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-970373ff-020e-477b-a6f9-a4e5c708535f" returned: 0 in 0.278s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-quobyte-970373ff-020e-477b-a6f9-a4e5c708535f" released by "delete_volume" :: held 0.774s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Created reservations ['224dce7e-72c8-4130-ad7a-33dd7c2187d8', '24b972a6-80d2-491a-8ca3-5d9837cdb262', '45e6d501-0591-4f31-aedd-8eaa89346781', '5eed44ea-e252-46b7-a7bf-c029c169f5f1'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:52 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:52 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:52 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Deleted volume successfully. Sep 01 12:47:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-06a99d1e-5c61-48e1-9d1a-183a5b36fea9 tempest-SnapshotsActionsTest-389319103 None] Lock "cinder-970373ff-020e-477b-a6f9-a4e5c708535f-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Flow 'volume_create_manager' (fffb6cae-457a-48a6-8919-2d043b2ce989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c42e7e-5f4b-4f11-8fee-dc6235f22b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c42e7e-5f4b-4f11-8fee-dc6235f22b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111626102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d872c9-d23e-4e00-91d7-38f070af5ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aebcc3894b14194ab9aa602c05a5b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:56Z,use_quota=True,user_id='25210efb53f6449ea8e0d65a8dfabf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddfdbdd-3789-40cb-aabb-53a998af514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddfdbdd-3789-40cb-aabb-53a998af514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d63156-e20f-42ca-89b1-2220c6881c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d63156-e20f-42ca-89b1-2220c6881c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d872c9-d23e-4e00-91d7-38f070af5ee6', 'volume_name': 'volume-24d872c9-d23e-4e00-91d7-38f070af5ee6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda2b32c-0643-4aa2-942c-4bc169052e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda2b32c-0643-4aa2-942c-4bc169052e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9048bc33-97b6-4021-afd5-5c228ce989d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Volume 24d872c9-d23e-4e00-91d7-38f070af5ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d872c9-d23e-4e00-91d7-38f070af5ee6', 'volume_size': 1} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111626102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d872c9-d23e-4e00-91d7-38f070af5ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aebcc3894b14194ab9aa602c05a5b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:47:56Z,use_quota=True,user_id='25210efb53f6449ea8e0d65a8dfabf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Creating volume 24d872c9-d23e-4e00-91d7-38f070af5ee6 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:47:56 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:56 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 1073741824 Sep 01 12:47:56 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:56 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 1073741824" returned: 0 in 0.450s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:56 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 Sep 01 12:47:56 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:56 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9048bc33-97b6-4021-afd5-5c228ce989d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d872c9-d23e-4e00-91d7-38f070af5ee6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48521a9c-419e-4fc0-b1cb-ef459660d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Volume volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 (24d872c9-d23e-4e00-91d7-38f070af5ee6): created successfully Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48521a9c-419e-4fc0-b1cb-ef459660d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Flow 'volume_create_manager' (fffb6cae-457a-48a6-8919-2d043b2ce989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4f44b0a0-3f7b-41f2-8763-4d953b00d361 tempest-ProjectReaderTests-1689334223 None] Created volume successfully. Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Acquiring lock "cinder-24d872c9-d23e-4e00-91d7-38f070af5ee6-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "cinder-24d872c9-d23e-4e00-91d7-38f070af5ee6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Acquiring lock "cinder-quobyte-24d872c9-d23e-4e00-91d7-38f070af5ee6" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "cinder-quobyte-24d872c9-d23e-4e00-91d7-38f070af5ee6" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c90190-113e-43b5-83e3-621e2621bcd6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:58 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 Sep 01 12:47:58 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:58 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6" returned: 0 in 0.370s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:58 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6 Sep 01 12:47:58 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:59 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-24d872c9-d23e-4e00-91d7-38f070af5ee6" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "cinder-quobyte-24d872c9-d23e-4e00-91d7-38f070af5ee6" released by "delete_volume" :: held 0.687s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Created reservations ['7a5602ae-8838-4b7f-968b-d41145595071', 'ccf5754e-38bd-4599-b370-be5e669a1db6', 'e1b62cd7-5fb4-4301-a003-d814a2031b9e', '419bc5ec-cf4f-44ca-9b2d-f2a5c0cc296c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:47:59 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:47:59 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:47:59 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:47:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Deleted volume successfully. Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-768bd6e7-e3de-49bc-b602-91a9b0863e5b tempest-ProjectReaderTests-1689334223 None] Lock "cinder-24d872c9-d23e-4e00-91d7-38f070af5ee6-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Flow 'volume_create_manager' (e13f55c1-602e-40ed-911d-08d243435743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5525e9d9-9f89-4218-902c-ab14dfae7096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5525e9d9-9f89-4218-902c-ab14dfae7096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538278351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ff1baf-120f-4ce2-be85-87818c4c2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aebcc3894b14194ab9aa602c05a5b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:00Z,use_quota=True,user_id='25210efb53f6449ea8e0d65a8dfabf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d89f78-c20c-4c6c-af7a-312106dac423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:47:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d89f78-c20c-4c6c-af7a-312106dac423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec7d4dc-f8be-41bd-bf3a-d0af032e5371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec7d4dc-f8be-41bd-bf3a-d0af032e5371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ff1baf-120f-4ce2-be85-87818c4c2f54', 'volume_name': 'volume-11ff1baf-120f-4ce2-be85-87818c4c2f54', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79955cae-57c0-4837-acb0-e9f3bc77c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79955cae-57c0-4837-acb0-e9f3bc77c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4400375-4bc7-4376-a82b-4075fece9445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:00 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Volume 11ff1baf-120f-4ce2-be85-87818c4c2f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ff1baf-120f-4ce2-be85-87818c4c2f54', 'volume_size': 1} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538278351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ff1baf-120f-4ce2-be85-87818c4c2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aebcc3894b14194ab9aa602c05a5b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:00Z,use_quota=True,user_id='25210efb53f6449ea8e0d65a8dfabf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Creating volume 11ff1baf-120f-4ce2-be85-87818c4c2f54 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:00 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:00 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 1073741824 Sep 01 12:48:00 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:00 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 1073741824" returned: 0 in 0.497s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:00 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 Sep 01 12:48:00 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:00 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4400375-4bc7-4376-a82b-4075fece9445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ff1baf-120f-4ce2-be85-87818c4c2f54', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955c7860-4415-43ff-8a67-645b1e87e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:00 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Volume volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 (11ff1baf-120f-4ce2-be85-87818c4c2f54): created successfully Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955c7860-4415-43ff-8a67-645b1e87e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Flow 'volume_create_manager' (e13f55c1-602e-40ed-911d-08d243435743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-997e3236-dde1-4659-a05f-2d97978dc5ea tempest-ProjectReaderTests-1689334223 None] Created volume successfully. Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Acquiring lock "cinder-11ff1baf-120f-4ce2-be85-87818c4c2f54-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "cinder-11ff1baf-120f-4ce2-be85-87818c4c2f54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Acquiring lock "cinder-quobyte-11ff1baf-120f-4ce2-be85-87818c4c2f54" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "cinder-quobyte-11ff1baf-120f-4ce2-be85-87818c4c2f54" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a073a-96f8-4b8b-b535-a43888eda446]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:02 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 Sep 01 12:48:02 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:02 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54" returned: 0 in 0.436s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:02 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54 Sep 01 12:48:02 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:02 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-11ff1baf-120f-4ce2-be85-87818c4c2f54" returned: 0 in 0.297s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "cinder-quobyte-11ff1baf-120f-4ce2-be85-87818c4c2f54" released by "delete_volume" :: held 0.784s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Created reservations ['d79b4532-c75c-4ba9-a048-f1e466bae440', 'c9758df4-b671-4be0-958b-e057ab575343', 'a24660f2-68fa-459a-a217-0116e5120455', '6fc0af7b-fbb5-4f7f-8906-f5f00826aa27'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:03 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:03 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:03 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.297s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Deleted volume successfully. Sep 01 12:48:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-212486af-1005-40d0-8fa2-4552a149d46f tempest-ProjectReaderTests-1689334223 None] Lock "cinder-11ff1baf-120f-4ce2-be85-87818c4c2f54-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (f2e85554-9b0e-4aa9-8d95-c7a45aaaf86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a6de9-abf7-4b32-8e07-4e33a1a2a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a6de9-abf7-4b32-8e07-4e33a1a2a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878518097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29132435-4bfc-40dd-a64b-9f53e55e1dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:08Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1391ce1f-c494-4634-8635-e378878b7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1391ce1f-c494-4634-8635-e378878b7750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa0fa8-8b2f-401e-b2e6-ce9aac680b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa0fa8-8b2f-401e-b2e6-ce9aac680b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29132435-4bfc-40dd-a64b-9f53e55e1dfa', 'volume_name': 'volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0175e3d3-3649-4fd3-955c-b47db742efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0175e3d3-3649-4fd3-955c-b47db742efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9e459e-c0c9-478b-b6b3-6335efc49d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Volume 29132435-4bfc-40dd-a64b-9f53e55e1dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa', 'volume_size': 1} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878518097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29132435-4bfc-40dd-a64b-9f53e55e1dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:08Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Creating volume 29132435-4bfc-40dd-a64b-9f53e55e1dfa {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:07 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:07 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa 1073741824 Sep 01 12:48:07 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:08 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa 1073741824" returned: 0 in 0.567s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:08 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa Sep 01 12:48:08 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-6d5120be-bc44-41a6-8a4d-d2a9c586be95 req-040848d5-45c4-4393-a38b-ee022d33c5bb tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:08 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa" returned: 0 in 0.303s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-6d5120be-bc44-41a6-8a4d-d2a9c586be95 req-040848d5-45c4-4393-a38b-ee022d33c5bb tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9e459e-c0c9-478b-b6b3-6335efc49d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820c3ce2-c523-41e5-add3-6c6ee32dee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-6d5120be-bc44-41a6-8a4d-d2a9c586be95 req-040848d5-45c4-4393-a38b-ee022d33c5bb tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Volume volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa (29132435-4bfc-40dd-a64b-9f53e55e1dfa): created successfully Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820c3ce2-c523-41e5-add3-6c6ee32dee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (f2e85554-9b0e-4aa9-8d95-c7a45aaaf86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b81abff9-c748-4606-bf50-2e0857066777 tempest-ProjectReaderTests-2122342916 None] Created volume successfully. Sep 01 12:48:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-6d5120be-bc44-41a6-8a4d-d2a9c586be95 req-040848d5-45c4-4393-a38b-ee022d33c5bb tempest-TestInstancesWithCinderVolumes-305003084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4af07797-0acf-4206-9d30-49ef628bc650', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:48:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-6d5120be-bc44-41a6-8a4d-d2a9c586be95 req-040848d5-45c4-4393-a38b-ee022d33c5bb tempest-TestInstancesWithCinderVolumes-305003084 None] attachment_update completed successfully. Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-29132435-4bfc-40dd-a64b-9f53e55e1dfa-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-29132435-4bfc-40dd-a64b-9f53e55e1dfa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Flow 'volume_create_manager' (4f73a05e-15ea-4a9c-8b2f-8fb4cad17303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c6ca40-45fe-4179-83da-0d1dbede641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c6ca40-45fe-4179-83da-0d1dbede641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-627135415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf177bf6-7f0c-4197-9e9b-201c33213d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07c602efde45e98f809a54811f6054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:10Z,use_quota=True,user_id='8bdfff2e76f74d008cb546123bc2e3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc84e565-9bae-4a4b-8c8b-6144dd68c986),volume_type_id=dc84e565-9bae-4a4b-8c8b-6144dd68c986)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ede546-d9ee-4354-b150-0c8d28312f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ede546-d9ee-4354-b150-0c8d28312f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9992919c-cefa-4a41-8a77-1b6499d0cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9992919c-cefa-4a41-8a77-1b6499d0cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf177bf6-7f0c-4197-9e9b-201c33213d72', 'volume_name': 'volume-cf177bf6-7f0c-4197-9e9b-201c33213d72', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1e496-7547-4f21-9b46-d65978bff0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1e496-7547-4f21-9b46-d65978bff0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdc344-0a62-4356-bef6-0779d9676413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Volume cf177bf6-7f0c-4197-9e9b-201c33213d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf177bf6-7f0c-4197-9e9b-201c33213d72', 'volume_size': 1} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-627135415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf177bf6-7f0c-4197-9e9b-201c33213d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c07c602efde45e98f809a54811f6054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:10Z,use_quota=True,user_id='8bdfff2e76f74d008cb546123bc2e3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc84e565-9bae-4a4b-8c8b-6144dd68c986),volume_type_id=dc84e565-9bae-4a4b-8c8b-6144dd68c986)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Creating volume cf177bf6-7f0c-4197-9e9b-201c33213d72 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:10 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:10 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 1073741824 Sep 01 12:48:10 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-quobyte-29132435-4bfc-40dd-a64b-9f53e55e1dfa" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-29132435-4bfc-40dd-a64b-9f53e55e1dfa" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[48decbfd-2709-4655-be02-f930e9688642]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:10 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa Sep 01 12:48:10 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:10 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:10 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 1073741824" returned: 0 in 0.539s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa" returned: 0 in 0.454s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:10 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa Sep 01 12:48:10 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:10 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 Sep 01 12:48:10 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0a31a384-eafd-473f-8d6c-9bfa57b530b8 req-af36fcc1-f1e6-46c8-a5a7-055de79d51c5 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:11 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29132435-4bfc-40dd-a64b-9f53e55e1dfa" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-29132435-4bfc-40dd-a64b-9f53e55e1dfa" released by "delete_volume" :: held 0.799s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:11 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0a31a384-eafd-473f-8d6c-9bfa57b530b8 req-af36fcc1-f1e6-46c8-a5a7-055de79d51c5 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.171s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cdc344-0a62-4356-bef6-0779d9676413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf177bf6-7f0c-4197-9e9b-201c33213d72', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e3b19f-6e26-479e-8ad7-f0f18a403923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0a31a384-eafd-473f-8d6c-9bfa57b530b8 req-af36fcc1-f1e6-46c8-a5a7-055de79d51c5 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Volume volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 (cf177bf6-7f0c-4197-9e9b-201c33213d72): created successfully Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e3b19f-6e26-479e-8ad7-f0f18a403923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Flow 'volume_create_manager' (4f73a05e-15ea-4a9c-8b2f-8fb4cad17303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e54efa91-b015-40bd-97a5-093b56caab46 tempest-VolumeTypesAccessTest-1438854194 None] Created volume successfully. Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Created reservations ['95ab9692-e9f1-4941-8a43-0ca1777b8d44', '3b0e6185-69fc-4cf6-ab9c-508ffb63de05', '09d68f19-5544-4534-b047-cb4faa1b4fb1', '5a906140-4e3e-4469-a80e-fae9206bcdf4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-0a31a384-eafd-473f-8d6c-9bfa57b530b8 req-af36fcc1-f1e6-46c8-a5a7-055de79d51c5 tempest-TestInstancesWithCinderVolumes-305003084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-3b5f9f5f-6866-4175-9881-153b91315713', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fc1b45f-88f9-4c6e-8ba2-6270c38494d6', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:48:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0a31a384-eafd-473f-8d6c-9bfa57b530b8 req-af36fcc1-f1e6-46c8-a5a7-055de79d51c5 tempest-TestInstancesWithCinderVolumes-305003084 None] attachment_update completed successfully. Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:11 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:11 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:11 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.288s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Deleted volume successfully. Sep 01 12:48:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d12d12dc-1705-4e27-9153-7c39c799d041 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-29132435-4bfc-40dd-a64b-9f53e55e1dfa-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Acquiring lock "cinder-cf177bf6-7f0c-4197-9e9b-201c33213d72-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "cinder-cf177bf6-7f0c-4197-9e9b-201c33213d72-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Acquiring lock "cinder-quobyte-cf177bf6-7f0c-4197-9e9b-201c33213d72" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "cinder-quobyte-cf177bf6-7f0c-4197-9e9b-201c33213d72" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b38ed-4412-409b-96c0-e25f61225661]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:12 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 Sep 01 12:48:12 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:12 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:12 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72 Sep 01 12:48:12 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (a47966bb-b4de-404e-9ee8-5e28db11afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34a2af9-2964-412b-9e8f-546286c95cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34a2af9-2964-412b-9e8f-546286c95cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493169607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185c9ac7-a3b3-426f-a3d0-8536375cccbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:13Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6198a5b-d553-44af-91bd-f12d54efdb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6198a5b-d553-44af-91bd-f12d54efdb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e4921-050d-4ed3-9bce-97f6b880aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74e4921-050d-4ed3-9bce-97f6b880aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185c9ac7-a3b3-426f-a3d0-8536375cccbb', 'volume_name': 'volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512730b3-a48d-4201-a8db-593a6411b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512730b3-a48d-4201-a8db-593a6411b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ca55bc-0b64-4760-8dca-692c6bf5e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:13 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Volume 185c9ac7-a3b3-426f-a3d0-8536375cccbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb', 'volume_size': 1} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493169607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185c9ac7-a3b3-426f-a3d0-8536375cccbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:13Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Creating volume 185c9ac7-a3b3-426f-a3d0-8536375cccbb {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:13 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:13 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb 1073741824 Sep 01 12:48:13 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:13 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cf177bf6-7f0c-4197-9e9b-201c33213d72" returned: 0 in 0.325s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "cinder-quobyte-cf177bf6-7f0c-4197-9e9b-201c33213d72" released by "delete_volume" :: held 0.793s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:13 devstack cinder-volume[87008]: WARNING cinder.quota [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-910756060 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-910756060, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:13 devstack cinder-volume[87008]: WARNING cinder.quota [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-910756060 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-910756060, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Created reservations ['7872bfa7-42d7-474c-996e-fb800d5a0fe0', 'ff0f64e4-c89f-46c0-a238-18a2fab1525e', '11134271-9472-40d5-a4ff-9804ca336f07', '0fb1ac08-fdd1-463f-9e33-58b0fae1c3e2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:13 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:13 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:13 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb 1073741824" returned: 0 in 0.580s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:13 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.363s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:13 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb Sep 01 12:48:13 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Deleted volume successfully. Sep 01 12:48:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-771d7607-b6bb-4ce5-9669-55fbd7ee2876 tempest-VolumeTypesAccessTest-1438854194 None] Lock "cinder-cf177bf6-7f0c-4197-9e9b-201c33213d72-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:14 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb" returned: 0 in 0.390s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ca55bc-0b64-4760-8dca-692c6bf5e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c3a772-b789-428c-9254-389ece2bfd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:14 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Volume volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb (185c9ac7-a3b3-426f-a3d0-8536375cccbb): created successfully Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c3a772-b789-428c-9254-389ece2bfd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (a47966bb-b4de-404e-9ee8-5e28db11afa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=177,cinder:INSERT=52,cinder:SELECT=162,cinder:DELETE=19 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:48:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a8748751-a03d-4978-862c-3b2aa3e4e6c1 tempest-ProjectReaderTests-2122342916 None] Created volume successfully. Sep 01 12:48:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=151,cinder:UPDATE=182,cinder:DELETE=13,cinder:INSERT=42 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-185c9ac7-a3b3-426f-a3d0-8536375cccbb-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "cinder-185c9ac7-a3b3-426f-a3d0-8536375cccbb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-quobyte-185c9ac7-a3b3-426f-a3d0-8536375cccbb" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-185c9ac7-a3b3-426f-a3d0-8536375cccbb" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a0f11-d7e8-4c8e-a07c-ffda42daf05c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:15 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb Sep 01 12:48:15 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:15 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb" returned: 0 in 0.431s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:15 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb Sep 01 12:48:15 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:15 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-185c9ac7-a3b3-426f-a3d0-8536375cccbb" returned: 0 in 0.298s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-185c9ac7-a3b3-426f-a3d0-8536375cccbb" released by "delete_volume" :: held 0.778s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Created reservations ['846e8c7e-ad98-4b75-85b5-4302218af9dc', 'd4316bc0-7150-4ce3-a79e-7b2ef1da9ae7', '5bd47a1c-6e0f-452f-84a7-e45e738900ff', '5cf8acb8-64be-4b3c-a117-52dbddee218c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:16 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:16 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:16 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Deleted volume successfully. Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-71385ab7-d084-4dec-a883-00cd401ab63c tempest-ProjectReaderTests-2122342916 None] Lock "cinder-185c9ac7-a3b3-426f-a3d0-8536375cccbb-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (fd7e6562-dd5d-4ab9-b230-b527b95c098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbcae63-6657-49a6-9828-adb0542ea69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbcae63-6657-49a6-9828-adb0542ea69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048496457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dce28a-6b8c-4fb5-8947-114994bd878c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:17Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bb8a7d-ffc5-46b9-be53-25e22a9626ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27bb8a7d-ffc5-46b9-be53-25e22a9626ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd1994-fb77-4803-9f8f-3fc9e0544872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd1994-fb77-4803-9f8f-3fc9e0544872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67dce28a-6b8c-4fb5-8947-114994bd878c', 'volume_name': 'volume-67dce28a-6b8c-4fb5-8947-114994bd878c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d615450e-0e7f-4719-aca8-cb386b5d79f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d615450e-0e7f-4719-aca8-cb386b5d79f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be184284-9934-4a38-a199-e275dd52c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Volume 67dce28a-6b8c-4fb5-8947-114994bd878c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67dce28a-6b8c-4fb5-8947-114994bd878c', 'volume_size': 1} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048496457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dce28a-6b8c-4fb5-8947-114994bd878c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:17Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Creating volume 67dce28a-6b8c-4fb5-8947-114994bd878c {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:17 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:17 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c 1073741824 Sep 01 12:48:17 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-51630566-f9d6-4ad7-b2f6-5f3d16f3d69d req-1b252fa2-4178-49f1-b067-357123837940 tempest-TestInstancesWithCinderVolumes-305003084 None] Terminate volume connection completed successfully. Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-51630566-f9d6-4ad7-b2f6-5f3d16f3d69d req-1b252fa2-4178-49f1-b067-357123837940 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleting attachment 4af07797-0acf-4206-9d30-49ef628bc650. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:48:17 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c 1073741824" returned: 0 in 0.531s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:17 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c Sep 01 12:48:17 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:17 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be184284-9934-4a38-a199-e275dd52c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67dce28a-6b8c-4fb5-8947-114994bd878c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f639a2-09d5-416d-8136-a302ab48e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Volume volume-67dce28a-6b8c-4fb5-8947-114994bd878c (67dce28a-6b8c-4fb5-8947-114994bd878c): created successfully Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f639a2-09d5-416d-8136-a302ab48e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (fd7e6562-dd5d-4ab9-b230-b527b95c098b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a2941617-498b-4f3e-adad-236286ac6488 tempest-ProjectReaderTests-2122342916 None] Created volume successfully. Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-b80fa4e1-fa03-421d-9e8d-3529f6bb952d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-b80fa4e1-fa03-421d-9e8d-3529f6bb952d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-quobyte-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb2c212-630c-47f0-b9c9-2ab7127271e8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:18 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d Sep 01 12:48:18 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:18 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" returned: 0 in 0.434s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:18 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d Sep 01 12:48:18 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:19 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" returned: 0 in 0.305s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-b80fa4e1-fa03-421d-9e8d-3529f6bb952d" released by "delete_volume" :: held 0.796s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-67dce28a-6b8c-4fb5-8947-114994bd878c-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-67dce28a-6b8c-4fb5-8947-114994bd878c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:19 devstack cinder-volume[87008]: WARNING cinder.quota [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-143092742-78594610 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-143092742-78594610, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:19 devstack cinder-volume[87008]: WARNING cinder.quota [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-143092742-78594610 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-143092742-78594610, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-quobyte-67dce28a-6b8c-4fb5-8947-114994bd878c" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Created reservations ['9295f140-d061-46ca-96aa-c21973847322', '9d1911fc-19ff-4ff9-9f30-1d5e64acb3f4', 'e99b7740-e01d-4166-aadb-9bc6dcf9cd5f', '251f3ea2-0b71-4a5a-ba69-a88c028b7125'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-67dce28a-6b8c-4fb5-8947-114994bd878c" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa65a04-94a5-4846-9254-e4871b17be2a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:19 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:19 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:19 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c Sep 01 12:48:19 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:19 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.302s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleted volume successfully. Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bbf05892-a077-4a7c-a36f-d0a34084f231 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-b80fa4e1-fa03-421d-9e8d-3529f6bb952d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:19 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:19 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c Sep 01 12:48:19 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:20 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-67dce28a-6b8c-4fb5-8947-114994bd878c" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-67dce28a-6b8c-4fb5-8947-114994bd878c" released by "delete_volume" :: held 0.811s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Created reservations ['6e7aed15-a299-45de-ac80-63ac73741675', 'eacfba98-22a2-4301-b5a1-f4d8a073a399', 'a70060e9-16d0-4ce6-82a3-da9a032496a7', '823f0e54-4615-4126-a131-71de508ea0e5'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:20 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:20 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:20 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.326s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Deleted volume successfully. Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbfb8a17-3d36-4be1-b412-54673bfb03e4 tempest-ProjectReaderTests-2122342916 None] Lock "cinder-67dce28a-6b8c-4fb5-8947-114994bd878c-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (21f34321-390b-4e13-ba11-829984f532a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c645f458-0471-49d0-9821-c961b095a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c645f458-0471-49d0-9821-c961b095a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011546937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:21Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ce8863-647b-4505-97de-96849edd8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ce8863-647b-4505-97de-96849edd8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56716df3-f46f-4661-806b-e3ee7a97c21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56716df3-f46f-4661-806b-e3ee7a97c21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92', 'volume_name': 'volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ac5766-bfba-446a-9dda-22c53a4f38ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ac5766-bfba-446a-9dda-22c53a4f38ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f8dab-eb60-48d3-bcca-30da3905ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:20 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Volume b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92', 'volume_size': 1} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1011546937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f02d0b486ab4b1eb6efbe2dd2d836a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:48:21Z,use_quota=True,user_id='6c245e9847e645abaf54277d17f1eb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Creating volume b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:48:21 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:21 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 1073741824 Sep 01 12:48:21 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:21 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 1073741824" returned: 0 in 0.524s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:21 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 Sep 01 12:48:21 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:21 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" returned: 0 in 0.308s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f8dab-eb60-48d3-bcca-30da3905ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acba080-1f94-408c-a6d4-a25da0a9d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:48:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Volume volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 (b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92): created successfully Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acba080-1f94-408c-a6d4-a25da0a9d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:48:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Flow 'volume_create_manager' (21f34321-390b-4e13-ba11-829984f532a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:48:21 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fc619049-9850-4d63-a789-383cd9cab13f tempest-ProjectReaderTests-2122342916 None] Created volume successfully. Sep 01 12:48:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-65d7b2bb-3c50-4d87-86d4-6d5d8e4b5cd5 req-5140476d-5d30-4f94-bc53-5c1bf5d13343 tempest-TestInstancesWithCinderVolumes-305003084 None] Terminate volume connection completed successfully. Sep 01 12:48:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-65d7b2bb-3c50-4d87-86d4-6d5d8e4b5cd5 req-5140476d-5d30-4f94-bc53-5c1bf5d13343 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleting attachment 2fc1b45f-88f9-4c6e-8ba2-6270c38494d6. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "cinder-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Acquiring lock "cinder-quobyte-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c351738-d1ca-40d7-91c7-e3f324941322]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-3b5f9f5f-6866-4175-9881-153b91315713-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-3b5f9f5f-6866-4175-9881-153b91315713-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:23 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 Sep 01 12:48:23 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-quobyte-3b5f9f5f-6866-4175-9881-153b91315713" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-3b5f9f5f-6866-4175-9881-153b91315713" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63e27d-a197-40d2-8c62-eeee60cade92]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:23 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 Sep 01 12:48:23 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:23 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" returned: 0 in 0.489s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:23 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92 Sep 01 12:48:23 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:23 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713" returned: 0 in 0.473s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:23 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713 Sep 01 12:48:23 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:23 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "cinder-quobyte-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92" released by "delete_volume" :: held 0.915s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Created reservations ['bc136e45-0221-49a1-a2a0-99514d9b7870', '7cb797fa-e7d4-4910-a438-a50191d7fcc6', '3fd7dd14-b274-49aa-82f8-fc6afc65d96c', '6b05749f-c4b4-4b10-9ac3-a1878e68544a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:24 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3b5f9f5f-6866-4175-9881-153b91315713" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-3b5f9f5f-6866-4175-9881-153b91315713" released by "delete_volume" :: held 0.881s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:24 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:24 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:24 devstack cinder-volume[87008]: WARNING cinder.quota [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1677865267-567642284 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1677865267-567642284, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:24 devstack cinder-volume[87008]: WARNING cinder.quota [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1677865267-567642284 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1677865267-567642284, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Created reservations ['741d886d-7a12-44fd-9104-7ee99cf7e1eb', '1245d1f0-b7c4-4c71-a95d-bb588f7a4fe2', '25b29c3e-0545-40a5-8cfd-9103fcce2a8f', '299c3d33-3785-440a-871e-a9fb32ff09bf'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:24 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:24 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:24 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Deleted volume successfully. Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6834cf3c-2263-4df3-a649-1a40eeab5bae tempest-ProjectReaderTests-2122342916 None] Lock "cinder-b42d1be5-0adf-4b83-b1a7-10a3a8dfdb92-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:24 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.370s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleted volume successfully. Sep 01 12:48:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0de0b2d1-eca1-4075-9b0f-6b76b0444259 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-3b5f9f5f-6866-4175-9881-153b91315713-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:26 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:26 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:27 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.400s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:48:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:48:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:48:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-a5b7b413-7028-4293-8812-ebf2d6d5ab74 req-69d0b123-00c6-4f3f-87bf-23cdda912e09 tempest-TestInstancesWithCinderVolumes-305003084 None] Terminate volume connection completed successfully. Sep 01 12:48:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-a5b7b413-7028-4293-8812-ebf2d6d5ab74 req-69d0b123-00c6-4f3f-87bf-23cdda912e09 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleting attachment 1ff0d92a-1db1-4f67-8db1-5d5024e3a50d. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-591a441c-56b2-4259-b751-0f1be6b971cc-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-591a441c-56b2-4259-b751-0f1be6b971cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "cinder-quobyte-591a441c-56b2-4259-b751-0f1be6b971cc" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-591a441c-56b2-4259-b751-0f1be6b971cc" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d5ba7-660a-45b0-b61b-831cf080e188]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:31 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc Sep 01 12:48:31 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:31 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:31 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc Sep 01 12:48:31 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:31 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-591a441c-56b2-4259-b751-0f1be6b971cc" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-quobyte-591a441c-56b2-4259-b751-0f1be6b971cc" released by "delete_volume" :: held 0.719s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:31 devstack cinder-volume[87008]: WARNING cinder.quota [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343238735-1189310464 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343238735-1189310464, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:31 devstack cinder-volume[87008]: WARNING cinder.quota [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343238735-1189310464 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343238735-1189310464, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Created reservations ['bdb74183-b8b8-4f5f-a362-57289eac1830', 'c617b30f-295f-4425-94f3-6ab57fbaa2e9', '80e6fc4d-dfd8-4d2d-9d43-1073ffd08883', '5b3866ee-12cd-4639-9b95-c1bb552d1f95'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:48:32 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:48:32 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:48:32 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.428s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:48:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Deleted volume successfully. Sep 01 12:48:32 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cc89cc1c-ae0e-4c00-a208-88e06e133d06 tempest-TestInstancesWithCinderVolumes-305003084 None] Lock "cinder-591a441c-56b2-4259-b751-0f1be6b971cc-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:48:42 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=38,cinder:INSERT=15,cinder:UPDATE=62,cinder:DELETE=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:48:42 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=46,cinder:SELECT=36,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Flow 'volume_create_manager' (e19412c2-b80c-4805-b711-bf5417b87774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c58c00-111a-4352-8450-ed5a10d321ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c58c00-111a-4352-8450-ed5a10d321ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1001861796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29832871-8a41-4dcc-817f-440b9a792508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8d7631c8d245128573a2e9eebb6fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:02Z,use_quota=True,user_id='284a7d5e75e54c72b39dc1920c25cfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27137371-7cb1-4dda-85d0-d5acbb3f1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27137371-7cb1-4dda-85d0-d5acbb3f1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd513c04-84ed-4a29-8ac9-135d6ebf3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd513c04-84ed-4a29-8ac9-135d6ebf3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29832871-8a41-4dcc-817f-440b9a792508', 'volume_name': 'volume-29832871-8a41-4dcc-817f-440b9a792508', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5b4230-b7cf-4630-8b38-1da90797cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5b4230-b7cf-4630-8b38-1da90797cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4dd9cb-8ac5-42ea-bae5-ffba7e7dac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:02 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Volume 29832871-8a41-4dcc-817f-440b9a792508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29832871-8a41-4dcc-817f-440b9a792508', 'volume_size': 1} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1001861796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29832871-8a41-4dcc-817f-440b9a792508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8d7631c8d245128573a2e9eebb6fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:02Z,use_quota=True,user_id='284a7d5e75e54c72b39dc1920c25cfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Creating volume 29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:02 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:02 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 1073741824 Sep 01 12:49:02 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:02 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 1073741824" returned: 0 in 0.627s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:02 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:02 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:03 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.317s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4dd9cb-8ac5-42ea-bae5-ffba7e7dac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29832871-8a41-4dcc-817f-440b9a792508', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ce3e86-0934-4be4-bc18-2433960019cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:03 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Volume volume-29832871-8a41-4dcc-817f-440b9a792508 (29832871-8a41-4dcc-817f-440b9a792508): created successfully Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ce3e86-0934-4be4-bc18-2433960019cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Flow 'volume_create_manager' (e19412c2-b80c-4805-b711-bf5417b87774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-18f22385-cde4-4e96-984a-f69b394b7b50 tempest-SnapshotDependencyTests-557111217 None] Created volume successfully. Sep 01 12:49:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Creating offline snapshot 43081ad7-ee3a-480f-9499-e6bdbf484b8a of volume 29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:49:04 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72af98b-4476-4c59-9962-7b3970cac6b0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:04 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:04 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:05 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.484s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:05 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a 1G Sep 01 12:49:05 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:06 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a 1G" returned: 0 in 0.800s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29832871-8a41-4dcc-817f-440b9a792508 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:06 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29832871-8a41-4dcc-817f-440b9a792508 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:06 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:06 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29832871-8a41-4dcc-817f-440b9a792508 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:06 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a is being set with open permissions: ugo+rw Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:06 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:06 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:06 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:06 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info Sep 01 12:49:06 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:07 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:07 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info is being set with open permissions: ugo+rw Sep 01 12:49:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:07 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info Sep 01 12:49:07 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:07 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.info" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e3d591cd-80cd-49fd-adcd-876e1694c31d tempest-SnapshotDependencyTests-557111217 None] Create snapshot completed successfully Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (65ee6096-adc7-444b-a962-d43b69a79340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0528e99-e19f-4693-8097-aad511434a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0528e99-e19f-4693-8097-aad511434a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-769919459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69147f5d-d082-4628-b8e0-45d5f895012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:08Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f59ee-3e92-4f1f-993c-b4bca7fe2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0f59ee-3e92-4f1f-993c-b4bca7fe2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be4e887-43bb-45a7-a4f7-fc631ecfc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be4e887-43bb-45a7-a4f7-fc631ecfc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69147f5d-d082-4628-b8e0-45d5f895012e', 'volume_name': 'volume-69147f5d-d082-4628-b8e0-45d5f895012e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d425b090-088b-481d-8a9b-8207b963e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d425b090-088b-481d-8a9b-8207b963e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69be026d-edc0-4203-a817-eee7cd9f6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Volume 69147f5d-d082-4628-b8e0-45d5f895012e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69147f5d-d082-4628-b8e0-45d5f895012e', 'volume_size': 1} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-769919459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69147f5d-d082-4628-b8e0-45d5f895012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:08Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Creating volume 69147f5d-d082-4628-b8e0-45d5f895012e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:08 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:08 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e 1073741824 Sep 01 12:49:08 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Flow 'volume_create_manager' (53326c06-f873-43b8-8a02-a91c484dd2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4fe64f-9dac-4107-b223-15e0417f1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4fe64f-9dac-4107-b223-15e0417f1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c965e73-cd0a-4b7f-9220-4b94380e52de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8d7631c8d245128573a2e9eebb6fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43081ad7-ee3a-480f-9499-e6bdbf484b8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:09Z,use_quota=True,user_id='284a7d5e75e54c72b39dc1920c25cfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0dee4b-5b7c-4ad6-86ab-603f77049cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0dee4b-5b7c-4ad6-86ab-603f77049cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ceefcf-de3f-4471-8cb0-5cacc81511d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ceefcf-de3f-4471-8cb0-5cacc81511d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c965e73-cd0a-4b7f-9220-4b94380e52de', 'volume_name': 'volume-8c965e73-cd0a-4b7f-9220-4b94380e52de', 'volume_size': 1, 'snapshot_id': '43081ad7-ee3a-480f-9499-e6bdbf484b8a'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e47e7-541d-452d-a6ee-79056ad0487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292e47e7-541d-452d-a6ee-79056ad0487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca8653-77e3-4735-9f30-bce3fd81046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Volume 8c965e73-cd0a-4b7f-9220-4b94380e52de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c965e73-cd0a-4b7f-9220-4b94380e52de', 'volume_size': 1, 'snapshot_id': '43081ad7-ee3a-480f-9499-e6bdbf484b8a'} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:09 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e 1073741824" returned: 0 in 0.776s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:09 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e Sep 01 12:49:09 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:09 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.435s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a-8c965e73-cd0a-4b7f-9220-4b94380e52de" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69be026d-edc0-4203-a817-eee7cd9f6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69147f5d-d082-4628-b8e0-45d5f895012e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cde4f5-3f5b-4455-bf0e-743fc1a3731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a-8c965e73-cd0a-4b7f-9220-4b94380e52de" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Creating volume 8c965e73-cd0a-4b7f-9220-4b94380e52de from snapshot 43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Volume volume-69147f5d-d082-4628-b8e0-45d5f895012e (69147f5d-d082-4628-b8e0-45d5f895012e): created successfully Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cde4f5-3f5b-4455-bf0e-743fc1a3731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (65ee6096-adc7-444b-a962-d43b69a79340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] snapshot: 43081ad7-ee3a-480f-9499-e6bdbf484b8a, volume: 8c965e73-cd0a-4b7f-9220-4b94380e52de, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:49:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-060f92b6-7cad-4e5a-9a19-572781cb199e tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a11655-4392-41cb-b842-7f34a79c264a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:09 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:09 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:10 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.656s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29832871-8a41-4dcc-817f-440b9a792508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e64107d-1807-43e6-9ef1-2d39bfd9ff08]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c5cddaa-7ce3-4447-ac62-f7ae2ba1b204 tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e" by "attach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c5cddaa-7ce3-4447-ac62-f7ae2ba1b204 tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e" acquired by "attach_volume" :: waited 0.040s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:10 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:10 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3c5cddaa-7ce3-4447-ac62-f7ae2ba1b204 tempest-VolumesActionsTest-99713902 None] Attaching volume 69147f5d-d082-4628-b8e0-45d5f895012e to instance beba56a9-bf2d-4c1e-bcd9-ed583da57a96 at mountpoint /dev/vdb on host None. Sep 01 12:49:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3c5cddaa-7ce3-4447-ac62-f7ae2ba1b204 tempest-VolumesActionsTest-99713902 None] Attach volume completed successfully. Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c5cddaa-7ce3-4447-ac62-f7ae2ba1b204 tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e" released by "attach_volume" :: held 0.387s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:11 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.548s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:49:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:11 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de Sep 01 12:49:11 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Terminate volume connection completed successfully. Sep 01 12:49:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" by "detach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Detaching volume 69147f5d-d082-4628-b8e0-45d5f895012e from instance beba56a9-bf2d-4c1e-bcd9-ed583da57a96. Sep 01 12:49:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Detach volume completed successfully. Sep 01 12:49:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e2767fb1-ab2c-4032-9542-6266fd8f7556 tempest-VolumesActionsTest-881160116 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" released by "detach_volume" :: held 0.317s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbd8a678-d9a7-49f9-87ab-ea44977ab605 tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" by "detach_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbd8a678-d9a7-49f9-87ab-ea44977ab605 tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cbd8a678-d9a7-49f9-87ab-ea44977ab605 tempest-VolumesActionsTest-99713902 None] Volume detach called, but volume not attached. Sep 01 12:49:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cbd8a678-d9a7-49f9-87ab-ea44977ab605 tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-quobyte-69147f5d-d082-4628-b8e0-45d5f895012e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "cinder-quobyte-69147f5d-d082-4628-b8e0-45d5f895012e" acquired by "delete_volume" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb372e8-ae2c-4882-be2b-84501a4a2acf]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:15 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e Sep 01 12:49:15 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:16 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e" returned: 0 in 1.498s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:16 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e Sep 01 12:49:16 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:17 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-69147f5d-d082-4628-b8e0-45d5f895012e" returned: 0 in 1.309s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "cinder-quobyte-69147f5d-d082-4628-b8e0-45d5f895012e" released by "delete_volume" :: held 3.025s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Created reservations ['d8f16b33-fd84-4923-8748-6a302c92e5c5', '2a9ca91f-e159-4e74-b11b-feb38223820b', '9ce9b692-fbfd-4924-9f05-8bd60befa899', '599d15ae-608a-470b-b7fe-4f493681b9a7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:18 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:18 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:19 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.913s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Deleted volume successfully. Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ba58ef4f-ca15-4862-a14c-0456e79bb48d tempest-VolumesActionsTest-99713902 None] Lock "cinder-69147f5d-d082-4628-b8e0-45d5f895012e-delete_volume" released by "delete_volume" :: held 4.909s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:19 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de" returned: 0 in 8.559s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:49:19 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Converted 1024.00 MB image at 119.62 MB/s Sep 01 12:49:19 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de is being set with open permissions: ugo+rw Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:19 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de Sep 01 12:49:19 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:19 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de" returned: 0 in 0.326s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" released by "_copy_volume_from_snapshot" :: held 10.253s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a-8c965e73-cd0a-4b7f-9220-4b94380e52de" released by "_create_volume_from_snapshot" :: held 10.382s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.439s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ca8653-77e3-4735-9f30-bce3fd81046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c965e73-cd0a-4b7f-9220-4b94380e52de', 'volume_size': 1, 'snapshot_id': '43081ad7-ee3a-480f-9499-e6bdbf484b8a'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404b0e78-c5ba-4be5-ac1a-a1f51f997ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:20 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Volume volume-8c965e73-cd0a-4b7f-9220-4b94380e52de (8c965e73-cd0a-4b7f-9220-4b94380e52de): created successfully Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404b0e78-c5ba-4be5-ac1a-a1f51f997ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Flow 'volume_create_manager' (53326c06-f873-43b8-8a02-a91c484dd2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9240f10d-8f12-4b00-ad7e-8748ef4b1377 tempest-SnapshotDependencyTests-557111217 None] Created volume successfully. Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-43081ad7-ee3a-480f-9499-e6bdbf484b8a-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-43081ad7-ee3a-480f-9499-e6bdbf484b8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Deleting offline snapshot 43081ad7-ee3a-480f-9499-e6bdbf484b8a of volume 29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] snapshot_file for this snap is: volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62455d0-5d20-470a-b877-10e7d403c08e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:21 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:21 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:21 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29832871-8a41-4dcc-817f-440b9a792508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77386a6-70ed-4768-83f2-d550ec6a0c03]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:21 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:21 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:22 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.641s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:22 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:22 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:22 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.504s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:22 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a Sep 01 12:49:22 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (83c629ac-6326-42fd-b977-0e08b02dc350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94493d0c-896a-4420-995b-21f142a545fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94493d0c-896a-4420-995b-21f142a545fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-55974807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60f0c6c-976b-436a-9369-d977af009791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:23Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882eb472-2030-4b45-a964-bcb471ffbdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882eb472-2030-4b45-a964-bcb471ffbdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f43c84-9445-41fb-8e13-7d0fecfaafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f43c84-9445-41fb-8e13-7d0fecfaafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60f0c6c-976b-436a-9369-d977af009791', 'volume_name': 'volume-f60f0c6c-976b-436a-9369-d977af009791', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6329c5e-9c61-420c-ae50-85b7d09a7c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6329c5e-9c61-420c-ae50-85b7d09a7c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31018f3f-94ec-4c30-978e-4af38a482cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Volume f60f0c6c-976b-436a-9369-d977af009791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60f0c6c-976b-436a-9369-d977af009791', 'volume_size': 1} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-55974807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60f0c6c-976b-436a-9369-d977af009791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:23Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Creating volume f60f0c6c-976b-436a-9369-d977af009791 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:22 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:22 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 1073741824 Sep 01 12:49:22 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:23 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508.43081ad7-ee3a-480f-9499-e6bdbf484b8a" returned: 0 in 0.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-43081ad7-ee3a-480f-9499-e6bdbf484b8a" released by "_delete_snapshot" :: held 2.066s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" released by "delete_snapshot" :: held 2.108s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Created reservations ['08b1780c-ee6e-4ee7-8b94-ff39999fe019', '8b8f858d-eeee-46f1-973b-369d5a4af2ae', '3612d934-0a3e-49cb-816f-a7bffaa83d97', 'd66257d0-9ce9-4dad-8a83-77f505e58a84'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Delete snapshot completed successfully. Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8918e9ee-d13b-44aa-b75f-99c95e94aca2 tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-43081ad7-ee3a-480f-9499-e6bdbf484b8a-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:23 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 1073741824" returned: 0 in 0.495s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:23 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 Sep 01 12:49:23 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:23 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31018f3f-94ec-4c30-978e-4af38a482cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60f0c6c-976b-436a-9369-d977af009791', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed7418-bed7-49f7-b2cd-9b7320b7edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Volume volume-f60f0c6c-976b-436a-9369-d977af009791 (f60f0c6c-976b-436a-9369-d977af009791): created successfully Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed7418-bed7-49f7-b2cd-9b7320b7edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (83c629ac-6326-42fd-b977-0e08b02dc350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-be1eb2c8-aa21-4e0a-a095-d27785370a17 tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-29832871-8a41-4dcc-817f-440b9a792508-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-29832871-8a41-4dcc-817f-440b9a792508-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea391d6-de6f-486f-8146-894bfc2b9edd]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:24 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:24 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:24 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:24 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508 Sep 01 12:49:24 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:24 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-29832871-8a41-4dcc-817f-440b9a792508" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-29832871-8a41-4dcc-817f-440b9a792508" released by "delete_volume" :: held 0.719s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Created reservations ['a806905f-6c7b-4352-a11b-87f801f91a58', 'e0ffa533-cd4f-476d-aab1-aa14d5dd004b', '9cd7b194-7075-4a83-be7a-c6518ac41ffa', '85ca7d10-fbe8-4331-862c-55b865112817'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-f60f0c6c-976b-436a-9369-d977af009791-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "cinder-f60f0c6c-976b-436a-9369-d977af009791-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-quobyte-f60f0c6c-976b-436a-9369-d977af009791" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-f60f0c6c-976b-436a-9369-d977af009791" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:25 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:25 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c2b41-6ccc-4109-8708-58117a047337]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:25 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 Sep 01 12:49:25 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-8c965e73-cd0a-4b7f-9220-4b94380e52de-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-8c965e73-cd0a-4b7f-9220-4b94380e52de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:25 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.303s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Deleted volume successfully. Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[50925ec6-4bb5-4a72-98fb-8a0434c31348]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-86c3276a-cd5d-4481-861b-3e4ed352d2af tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-29832871-8a41-4dcc-817f-440b9a792508-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:25 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de Sep 01 12:49:25 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:25 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791" returned: 0 in 0.516s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:25 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791 Sep 01 12:49:25 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:25 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:26 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de Sep 01 12:49:26 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:26 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f60f0c6c-976b-436a-9369-d977af009791" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-f60f0c6c-976b-436a-9369-d977af009791" released by "delete_volume" :: held 0.853s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Created reservations ['ff33a894-0635-4e43-a559-0765578f076f', '2a4af617-e510-47ff-bd51-688cf9e4e851', 'ff910add-8d18-4ad0-8250-a12eab4d9618', 'a315122d-59df-4cfe-bb23-77366b30b73d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:26 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8c965e73-cd0a-4b7f-9220-4b94380e52de" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:26 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:26 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-quobyte-8c965e73-cd0a-4b7f-9220-4b94380e52de" released by "delete_volume" :: held 0.886s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Created reservations ['b37a55a2-f753-470f-8b8b-6305f5001e7a', '64de4a63-d8af-4233-bd7f-9be5a40b9474', '25ec3f11-b69c-410b-9585-21c2bec1abc8', '71ea0dee-93a3-46a4-bcb2-f8fa49579553'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:26 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:26 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:26 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:26 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:26 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.569s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Deleted volume successfully. Sep 01 12:49:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc867405-9556-494a-bb61-0824f944986c tempest-VolumesActionsTest-881160116 None] Lock "cinder-f60f0c6c-976b-436a-9369-d977af009791-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:27 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.549s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Deleted volume successfully. Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c45f1bc8-3e13-46da-a788-8fa0e48ffbcd tempest-SnapshotDependencyTests-557111217 None] Lock "cinder-8c965e73-cd0a-4b7f-9220-4b94380e52de-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:27 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.561s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (55631fcc-5701-4659-bcf8-acac06469610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5063b3d7-7326-44d8-adf0-52c7c65493a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5063b3d7-7326-44d8-adf0-52c7c65493a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781147234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bd7235-4724-4a64-89f3-e20f8537694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:27Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff750cc1-498e-4f72-a6b8-3b9a5d7189ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff750cc1-498e-4f72-a6b8-3b9a5d7189ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deaa238-5b83-4471-a461-3d79e24f9261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deaa238-5b83-4471-a461-3d79e24f9261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bd7235-4724-4a64-89f3-e20f8537694e', 'volume_name': 'volume-46bd7235-4724-4a64-89f3-e20f8537694e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9c7f0e-1cd0-49b0-b680-77bf7fd2188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9c7f0e-1cd0-49b0-b680-77bf7fd2188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4146e817-dd55-458d-8747-fe85af748fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:27 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Volume 46bd7235-4724-4a64-89f3-e20f8537694e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bd7235-4724-4a64-89f3-e20f8537694e', 'volume_size': 1} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781147234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bd7235-4724-4a64-89f3-e20f8537694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:27Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Creating volume 46bd7235-4724-4a64-89f3-e20f8537694e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:27 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:27 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e 1073741824 Sep 01 12:49:27 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:28 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e 1073741824" returned: 0 in 0.601s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:28 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e Sep 01 12:49:28 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:28 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4146e817-dd55-458d-8747-fe85af748fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bd7235-4724-4a64-89f3-e20f8537694e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6124521b-2cb1-4324-b8e5-8129f0cda76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:28 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Volume volume-46bd7235-4724-4a64-89f3-e20f8537694e (46bd7235-4724-4a64-89f3-e20f8537694e): created successfully Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6124521b-2cb1-4324-b8e5-8129f0cda76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:28 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (55631fcc-5701-4659-bcf8-acac06469610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9613c752-85e4-4cf0-ac6e-b37c39c6b7b1 tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-46bd7235-4724-4a64-89f3-e20f8537694e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "cinder-46bd7235-4724-4a64-89f3-e20f8537694e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-quobyte-46bd7235-4724-4a64-89f3-e20f8537694e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-46bd7235-4724-4a64-89f3-e20f8537694e" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0fbb0-3db5-4648-9fd5-16847babe9d9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:29 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e Sep 01 12:49:29 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:30 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e" returned: 0 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:30 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e Sep 01 12:49:30 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:30 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-46bd7235-4724-4a64-89f3-e20f8537694e" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-46bd7235-4724-4a64-89f3-e20f8537694e" released by "delete_volume" :: held 0.831s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Created reservations ['735589b7-0d09-46a9-bb12-9bc8169ad654', '8add8c0b-e44e-4d86-aaca-c5e2b93a0633', 'b7a60bf0-e707-40f7-9bd7-3a7d69b1e3b9', '4a2cffae-29f7-40e4-94a9-c718337331c6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:30 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:30 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:30 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.336s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Deleted volume successfully. Sep 01 12:49:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3bdaf0ab-70d0-47da-b4c1-fbcbdb9f3eb0 tempest-VolumesActionsTest-881160116 None] Lock "cinder-46bd7235-4724-4a64-89f3-e20f8537694e-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (a6250a4c-95f5-45b4-8b40-95f3dc043e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d700eb1-0315-4eeb-8aa5-94c5f1a423da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d700eb1-0315-4eeb-8aa5-94c5f1a423da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900405902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:32Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865a3bc-4f87-4c2e-95c0-be3ce5bd2510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865a3bc-4f87-4c2e-95c0-be3ce5bd2510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652fd33c-e13b-4dab-9b56-82dd07ceb7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652fd33c-e13b-4dab-9b56-82dd07ceb7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6', 'volume_name': 'volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8acdb0-f794-4d6f-becd-30ba18778b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8acdb0-f794-4d6f-becd-30ba18778b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a099-4705-4133-8f7a-6fb05303a20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Volume e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6', 'volume_size': 1} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900405902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:32Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Creating volume e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:31 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:31 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 1073741824 Sep 01 12:49:31 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:32 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 1073741824" returned: 0 in 0.590s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:32 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 Sep 01 12:49:32 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:32 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a099-4705-4133-8f7a-6fb05303a20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf008a6-25be-4e66-95da-c0d81bcb2d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Volume volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 (e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6): created successfully Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf008a6-25be-4e66-95da-c0d81bcb2d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (a6250a4c-95f5-45b4-8b40-95f3dc043e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a7124189-fd23-4d78-bed5-9e0db8f55335 tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "cinder-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-quobyte-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408dc7a-72e1-49b0-89b6-f5ca6e767d3d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:34 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 Sep 01 12:49:34 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:34 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" returned: 0 in 0.432s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:34 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6 Sep 01 12:49:34 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:34 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" returned: 0 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6" released by "delete_volume" :: held 0.801s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Created reservations ['a891b2f4-7ace-4fcc-afc0-f679c981c351', 'c2954790-943c-4eeb-b734-09b1924f9178', 'e2f2f3cd-8d94-477e-9656-f8306c9ec15b', '7878f43e-0d8d-42aa-8c00-81b969b91164'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:34 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:34 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:34 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:35 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.312s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Deleted volume successfully. Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-6f63d889-523c-4d13-b970-ecfc83c62233 tempest-VolumesActionsTest-881160116 None] Lock "cinder-e29360d0-b75d-4fc2-a3aa-ff6b0141c1d6-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (3ca2689d-f2ec-42c0-a09b-0a37a8fc2f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d501fce7-d3cd-49e9-909e-3918b5b20d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d501fce7-d3cd-49e9-909e-3918b5b20d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1783554401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91de324-db18-4974-bd13-3d554efaf267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:36Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca054ec-ee23-4fe5-8381-700064d65240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca054ec-ee23-4fe5-8381-700064d65240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83057f69-6232-42cd-9f47-07ea6668e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83057f69-6232-42cd-9f47-07ea6668e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91de324-db18-4974-bd13-3d554efaf267', 'volume_name': 'volume-c91de324-db18-4974-bd13-3d554efaf267', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69c004-c7da-4925-86ec-17ce194c94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69c004-c7da-4925-86ec-17ce194c94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d35eaca-92e6-4df4-a6c8-05a74f9eced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Volume c91de324-db18-4974-bd13-3d554efaf267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91de324-db18-4974-bd13-3d554efaf267', 'volume_size': 1} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1783554401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91de324-db18-4974-bd13-3d554efaf267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:36Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Creating volume c91de324-db18-4974-bd13-3d554efaf267 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:35 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:35 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 1073741824 Sep 01 12:49:35 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:36 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 1073741824" returned: 0 in 0.542s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:36 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 Sep 01 12:49:36 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Flow 'volume_create_manager' (e1541f27-dfeb-42f1-89c7-1861f8dd392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cc401c-18c0-49c8-a85d-1db957cce862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cc401c-18c0-49c8-a85d-1db957cce862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1797232940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e199c1bc-66f3-49b2-9c29-07f85bf1b7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf07dbf39a34126abdb2649c0d2fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:36Z,use_quota=True,user_id='92ac72f054d7424b867a3302dd4d976f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61436186-0871-40bf-8c28-7ee7b2eab23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61436186-0871-40bf-8c28-7ee7b2eab23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11caa22-a2f1-4133-a719-63003b821732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:49:36 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d35eaca-92e6-4df4-a6c8-05a74f9eced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91de324-db18-4974-bd13-3d554efaf267', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7771769d-1480-4377-9438-5a15609489ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Volume volume-c91de324-db18-4974-bd13-3d554efaf267 (c91de324-db18-4974-bd13-3d554efaf267): created successfully Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7771769d-1480-4377-9438-5a15609489ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (3ca2689d-f2ec-42c0-a09b-0a37a8fc2f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d1382d34-4c3b-4dbf-a9a4-f33b8833b285 tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11caa22-a2f1-4133-a719-63003b821732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'volume_name': 'volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f726e-60f3-405b-82b5-0ef34fbe2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7f726e-60f3-405b-82b5-0ef34fbe2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea21c5cc-83ec-4d66-a9d3-1463e093c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:37 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Trying to clone e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 from image 903fc775-9c21-408b-9650-9b60d3b1eb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:49:37 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f0460-8170-40ee-a869-597042defcd8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:37 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD Sep 01 12:49:37 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:37 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 is fetched for user 92ac72f054d7424b867a3302dd4d976f. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f387d26-430b-465b-b637-d98db4c8832a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:38 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD Sep 01 12:49:38 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-c91de324-db18-4974-bd13-3d554efaf267-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "cinder-c91de324-db18-4974-bd13-3d554efaf267-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Acquiring lock "cinder-quobyte-c91de324-db18-4974-bd13-3d554efaf267" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-c91de324-db18-4974-bd13-3d554efaf267" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74ff882-f7dd-4ae4-94a3-87d99bcefb17]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:38 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:38 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1797232940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e199c1bc-66f3-49b2-9c29-07f85bf1b7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf07dbf39a34126abdb2649c0d2fc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:36Z,use_quota=True,user_id='92ac72f054d7424b867a3302dd4d976f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Creating volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:38 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:38 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1073741824 Sep 01 12:49:38 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:38 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:38 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267 Sep 01 12:49:38 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:38 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1073741824" returned: 0 in 0.573s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:38 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 Sep 01 12:49:38 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:38 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c91de324-db18-4974-bd13-3d554efaf267" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "cinder-quobyte-c91de324-db18-4974-bd13-3d554efaf267" released by "delete_volume" :: held 0.842s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Created reservations ['54319e42-1f8b-47fb-8c55-60d171cca952', '93fac04e-8ee1-44fb-a909-e6e1e47d7451', '23799315-4ad7-4f62-baaa-92284ec5175e', 'df728cd8-5838-419e-889c-5bd6908633d2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:39 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:39 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:39 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" returned: 0 in 0.303s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Attempting download of 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d78f9b-4e66-4621-adc5-fc83ebc13511]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:39 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Deleted volume successfully. Sep 01 12:49:39 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx Sep 01 12:49:39 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fc710655-b6e3-4188-810e-875cdb71c39c tempest-VolumesActionsTest-881160116 None] Lock "cinder-c91de324-db18-4974-bd13-3d554efaf267-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:39 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx" returned: 0 in 0.497s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (4cf75fb2-a5e7-4f7c-8d70-6006b51800d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4690f3-ebab-41a6-91b5-27c7057da7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4690f3-ebab-41a6-91b5-27c7057da7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024867697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3c58b0-bd36-417a-8a27-faa4f6d5a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:40Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79da3b1f-2ce3-4b98-b73f-a405b079077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79da3b1f-2ce3-4b98-b73f-a405b079077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c5a556-a8d3-4bcd-b022-37b9a52c6eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c5a556-a8d3-4bcd-b022-37b9a52c6eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca3c58b0-bd36-417a-8a27-faa4f6d5a944', 'volume_name': 'volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc92c58-3f91-4239-b543-3adb1d9580bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc92c58-3f91-4239-b543-3adb1d9580bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f910fa-0e81-45db-b7cf-43dc8ff9a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Volume ca3c58b0-bd36-417a-8a27-faa4f6d5a944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944', 'volume_size': 1} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024867697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3c58b0-bd36-417a-8a27-faa4f6d5a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf7a6fa88ab4f6abb16c9a4b8b25f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:40Z,use_quota=True,user_id='9f1cc995056349c986ed9da714ec9a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Creating volume ca3c58b0-bd36-417a-8a27-faa4f6d5a944 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:40 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:40 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 1073741824 Sep 01 12:49:40 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:40 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx" returned: 1 in 0.423s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7c5rfjtx' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd538aa0-7e18-4660-976e-15ac979e6bb2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:40 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD Sep 01 12:49:40 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:40 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 1073741824" returned: 0 in 0.511s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:40 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 Sep 01 12:49:40 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:40 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] 903fc775-9c21-408b-9650-9b60d3b1eb91 was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:40 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 Sep 01 12:49:40 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:40 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f910fa-0e81-45db-b7cf-43dc8ff9a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c735a02-9f34-47a1-bf53-df3216d13a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Volume volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 (ca3c58b0-bd36-417a-8a27-faa4f6d5a944): created successfully Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c735a02-9f34-47a1-bf53-df3216d13a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Flow 'volume_create_manager' (4cf75fb2-a5e7-4f7c-8d70-6006b51800d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b726d5a2-1967-404f-b7f1-e04fef203ea0 tempest-VolumesActionsTest-99713902 None] Created volume successfully. Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-ca3c58b0-bd36-417a-8a27-faa4f6d5a944-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "cinder-ca3c58b0-bd36-417a-8a27-faa4f6d5a944-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:42 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" returned: 0 in 2.017s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_vsklo83odevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:49:42 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Converted 112.00 MB image at 55.50 MB/s Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Acquiring lock "cinder-quobyte-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:49:42 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1G Sep 01 12:49:42 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "cinder-quobyte-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be24754-918e-4cbb-a8bf-34abaf458a04]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:49:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:42 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 Sep 01 12:49:42 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:43 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 1G" returned: 0 in 0.333s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Downloaded image 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 for user 92ac72f054d7424b867a3302dd4d976f is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Marking volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Copying metadata from image 903fc775-9c21-408b-9650-9b60d3b1eb91 to e199c1bc-66f3-49b2-9c29-07f85bf1b7e3. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Creating volume glance metadata for volume e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 backed by image 903fc775-9c21-408b-9650-9b60d3b1eb91 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:49:43 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" returned: 0 in 0.374s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:43 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944 Sep 01 12:49:43 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea21c5cc-83ec-4d66-a9d3-1463e093c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8377c5c3-6ac8-4f81-acee-2483a8c81d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:43 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Volume volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 (e199c1bc-66f3-49b2-9c29-07f85bf1b7e3): created successfully Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8377c5c3-6ac8-4f81-acee-2483a8c81d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Flow 'volume_create_manager' (e1541f27-dfeb-42f1-89c7-1861f8dd392b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cc3fee4b-a013-4175-8ea3-83c898399049 tempest-TestShelveInstance-353328884 None] Created volume successfully. Sep 01 12:49:43 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "cinder-quobyte-ca3c58b0-bd36-417a-8a27-faa4f6d5a944" released by "delete_volume" :: held 0.681s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Created reservations ['ca5319fc-dbf0-4519-ba52-538c9994d3b1', 'e6cc38cc-cd86-4a08-a4fd-953c6023599b', '3804f67c-4ee5-4d1b-87a4-c851753652ea', 'de571a1b-ba25-493a-87a5-ccba9a1df746'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:43 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:49:43 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:43 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:49:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Deleted volume successfully. Sep 01 12:49:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-19243f14-b884-4962-8242-ad20a0e2bafc tempest-VolumesActionsTest-99713902 None] Lock "cinder-ca3c58b0-bd36-417a-8a27-faa4f6d5a944-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:49:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-351b895e-742a-4f4d-bf0e-9e72298516e8 req-5f7f5743-2792-4fe3-b564-90739a16c2e5 tempest-TestShelveInstance-353328884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-351b895e-742a-4f4d-bf0e-9e72298516e8 req-5f7f5743-2792-4fe3-b564-90739a16c2e5 tempest-TestShelveInstance-353328884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-351b895e-742a-4f4d-bf0e-9e72298516e8 req-5f7f5743-2792-4fe3-b564-90739a16c2e5 tempest-TestShelveInstance-353328884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-351b895e-742a-4f4d-bf0e-9e72298516e8 req-5f7f5743-2792-4fe3-b564-90739a16c2e5 tempest-TestShelveInstance-353328884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aa671f1-595a-44a5-a454-4d7ee9ed9def', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:49:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-351b895e-742a-4f4d-bf0e-9e72298516e8 req-5f7f5743-2792-4fe3-b564-90739a16c2e5 tempest-TestShelveInstance-353328884 None] attachment_update completed successfully. Sep 01 12:49:57 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=102,cinder:SELECT=89,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:49:57 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=91,cinder:UPDATE=107,cinder:DELETE=9,cinder:INSERT=36 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (1fd2a105-2c92-4bfb-8bd8-e29ae0d4e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e333af-946e-46e9-a8b6-629df06c3c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e333af-946e-46e9-a8b6-629df06c3c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1825634952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9822d901-fcd7-44f8-8481-8234034b9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:59Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93674b3-9e6c-44cc-b9c5-cdfad5d992a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93674b3-9e6c-44cc-b9c5-cdfad5d992a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ddd311-b721-4166-b2f5-725045561239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ddd311-b721-4166-b2f5-725045561239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9822d901-fcd7-44f8-8481-8234034b9c34', 'volume_name': 'volume-9822d901-fcd7-44f8-8481-8234034b9c34', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74b9e2-1962-4668-b99a-86dfde0c4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74b9e2-1962-4668-b99a-86dfde0c4f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128ee6ac-647e-41e2-99e6-c76df4d1f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:49:59 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Volume 9822d901-fcd7-44f8-8481-8234034b9c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9822d901-fcd7-44f8-8481-8234034b9c34', 'volume_size': 1} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1825634952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9822d901-fcd7-44f8-8481-8234034b9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:49:59Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Creating volume 9822d901-fcd7-44f8-8481-8234034b9c34 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:49:59 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:59 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 1073741824 Sep 01 12:49:59 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:49:59 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 1073741824" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:49:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:49:59 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 Sep 01 12:49:59 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:00 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128ee6ac-647e-41e2-99e6-c76df4d1f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9822d901-fcd7-44f8-8481-8234034b9c34', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d430ede7-0f89-453c-b97f-7a371771acc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:00 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Volume volume-9822d901-fcd7-44f8-8481-8234034b9c34 (9822d901-fcd7-44f8-8481-8234034b9c34): created successfully Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d430ede7-0f89-453c-b97f-7a371771acc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (1fd2a105-2c92-4bfb-8bd8-e29ae0d4e9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-61da54ae-b13b-46bc-8c6e-1a0e650af976 tempest-VolumesListAdminTestJSON-108937354 None] Created volume successfully. Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (5dbeac2c-efde-4efa-b531-afbe617040ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a32150-c8d5-4b64-91cf-25cb6a1dc7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a32150-c8d5-4b64-91cf-25cb6a1dc7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1295974845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd8885e-6616-46d8-9d84-3a4c2a351af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:02Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea757d51-9615-4af4-b7f9-2114881c4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea757d51-9615-4af4-b7f9-2114881c4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0f34f4-effa-41f9-9cf3-0f8221809d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0f34f4-effa-41f9-9cf3-0f8221809d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd8885e-6616-46d8-9d84-3a4c2a351af5', 'volume_name': 'volume-efd8885e-6616-46d8-9d84-3a4c2a351af5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ea36ea-20d2-46af-bbc6-06e520c43229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ea36ea-20d2-46af-bbc6-06e520c43229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa459ad3-ea3d-484d-a9dd-44710ab638e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Volume efd8885e-6616-46d8-9d84-3a4c2a351af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd8885e-6616-46d8-9d84-3a4c2a351af5', 'volume_size': 1} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1295974845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd8885e-6616-46d8-9d84-3a4c2a351af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:02Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Creating volume efd8885e-6616-46d8-9d84-3a4c2a351af5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:01 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:01 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 1073741824 Sep 01 12:50:01 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:02 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 1073741824" returned: 0 in 0.438s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:02 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 Sep 01 12:50:02 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:02 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa459ad3-ea3d-484d-a9dd-44710ab638e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd8885e-6616-46d8-9d84-3a4c2a351af5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e2c32-90a3-4b97-809f-114ae9c79eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:02 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Volume volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 (efd8885e-6616-46d8-9d84-3a4c2a351af5): created successfully Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e2c32-90a3-4b97-809f-114ae9c79eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (5dbeac2c-efde-4efa-b531-afbe617040ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8fa029b5-2f8e-4f28-9f07-959e3a528a8b tempest-VolumesListAdminTestJSON-108937354 None] Created volume successfully. Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (18633cce-be50-40bf-abbc-d72f5f8e7aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a96338-5982-4cda-865b-56b5198fd126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a96338-5982-4cda-865b-56b5198fd126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2031706126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd23340-a0fd-4be1-96e3-022915adee69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:04Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a67f40a-35c2-4622-8769-14734751acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a67f40a-35c2-4622-8769-14734751acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f9233f-cbe8-483e-9165-4f6643b6d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f9233f-cbe8-483e-9165-4f6643b6d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd23340-a0fd-4be1-96e3-022915adee69', 'volume_name': 'volume-8bd23340-a0fd-4be1-96e3-022915adee69', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ef4a9-9d10-4e8e-8cfc-baf30de07a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ef4a9-9d10-4e8e-8cfc-baf30de07a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54146d-b7ff-4aca-93dc-57757b386acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:04 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Volume 8bd23340-a0fd-4be1-96e3-022915adee69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd23340-a0fd-4be1-96e3-022915adee69', 'volume_size': 1} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2031706126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd23340-a0fd-4be1-96e3-022915adee69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bca21a7a6042bab47468e9fc7db769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:04Z,use_quota=True,user_id='a700a208b5d94b9687fb9ef7040d51bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Creating volume 8bd23340-a0fd-4be1-96e3-022915adee69 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:04 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:04 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 1073741824 Sep 01 12:50:04 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:05 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 1073741824" returned: 0 in 0.465s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:05 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 Sep 01 12:50:05 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:05 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69" returned: 0 in 0.247s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54146d-b7ff-4aca-93dc-57757b386acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd23340-a0fd-4be1-96e3-022915adee69', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336cca15-3387-4869-bc7a-66a8d61f8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:05 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Volume volume-8bd23340-a0fd-4be1-96e3-022915adee69 (8bd23340-a0fd-4be1-96e3-022915adee69): created successfully Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336cca15-3387-4869-bc7a-66a8d61f8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Flow 'volume_create_manager' (18633cce-be50-40bf-abbc-d72f5f8e7aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9ab983a2-db04-4c45-a326-71beedf18a6c tempest-VolumesListAdminTestJSON-108937354 None] Created volume successfully. Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Flow 'volume_create_manager' (9107fd83-b630-456e-abf2-1449ebb42387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e109fd5e-801d-449e-9f0a-cedbb20e4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e109fd5e-801d-449e-9f0a-cedbb20e4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1189018-895d-4498-9f22-4e49a559b78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644e4705f5f64c708d85c5590bb67c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:06Z,use_quota=True,user_id='20c143a79bbc4aa2b5be7666635bb1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b3980-e4ad-4a13-be4d-923bb2cd7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b3980-e4ad-4a13-be4d-923bb2cd7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249d7272-12e0-43ee-a32a-dcadf868af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249d7272-12e0-43ee-a32a-dcadf868af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1189018-895d-4498-9f22-4e49a559b78f', 'volume_name': 'volume-b1189018-895d-4498-9f22-4e49a559b78f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0cb1ab-ca84-49d7-80ab-b39e714d92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0cb1ab-ca84-49d7-80ab-b39e714d92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c556dac-0942-4531-b1da-610ed1c259a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Volume b1189018-895d-4498-9f22-4e49a559b78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1189018-895d-4498-9f22-4e49a559b78f', 'volume_size': 1} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1189018-895d-4498-9f22-4e49a559b78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='644e4705f5f64c708d85c5590bb67c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:06Z,use_quota=True,user_id='20c143a79bbc4aa2b5be7666635bb1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Creating volume b1189018-895d-4498-9f22-4e49a559b78f {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:06 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:06 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f 1073741824 Sep 01 12:50:06 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:06 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f 1073741824" returned: 0 in 0.480s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:06 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f Sep 01 12:50:06 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:07 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c556dac-0942-4531-b1da-610ed1c259a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1189018-895d-4498-9f22-4e49a559b78f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e7720-bcd2-4027-90ad-e6c048d75bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Volume volume-b1189018-895d-4498-9f22-4e49a559b78f (b1189018-895d-4498-9f22-4e49a559b78f): created successfully Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592e7720-bcd2-4027-90ad-e6c048d75bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Flow 'volume_create_manager' (9107fd83-b630-456e-abf2-1449ebb42387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d5469f8b-ce56-440b-98b0-4e75f7742cc6 tempest-VolumesListAdminTestJSON-1746289650 None] Created volume successfully. Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Acquiring lock "cinder-b1189018-895d-4498-9f22-4e49a559b78f-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "cinder-b1189018-895d-4498-9f22-4e49a559b78f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Acquiring lock "cinder-quobyte-b1189018-895d-4498-9f22-4e49a559b78f" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "cinder-quobyte-b1189018-895d-4498-9f22-4e49a559b78f" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f1618-448b-47a8-bebf-081f1e023804]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-8bd23340-a0fd-4be1-96e3-022915adee69-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-8bd23340-a0fd-4be1-96e3-022915adee69-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-quobyte-8bd23340-a0fd-4be1-96e3-022915adee69" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-8bd23340-a0fd-4be1-96e3-022915adee69" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94080c-3cab-4f09-8450-81e21b15f17c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:08 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f Sep 01 12:50:08 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:08 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 Sep 01 12:50:08 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:09 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f" returned: 0 in 0.454s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:09 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f Sep 01 12:50:09 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:09 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69" returned: 0 in 0.423s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:09 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69 Sep 01 12:50:09 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:09 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-b1189018-895d-4498-9f22-4e49a559b78f" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "cinder-quobyte-b1189018-895d-4498-9f22-4e49a559b78f" released by "delete_volume" :: held 0.784s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Created reservations ['146fc235-6324-4fc5-9b26-87b7e1bbf5c4', '38197c6a-b543-4e95-a0e5-8bbeea9bcdc0', 'e5b19324-03a4-4f11-b2ff-905143182719', '2422d769-eba9-43e0-8124-f28128e9beef'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:09 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8bd23340-a0fd-4be1-96e3-022915adee69" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-8bd23340-a0fd-4be1-96e3-022915adee69" released by "delete_volume" :: held 0.759s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:09 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:09 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Created reservations ['25db66a6-a128-4b00-91ed-fb966dfaf912', '693e0340-57a2-4288-8d94-c76ba709be71', '0bfe3ca9-f5cd-4980-83bf-7cc7a3a73201', '45a9620d-3e3f-4f9f-b531-476d7c8151b0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:09 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:09 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:09 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Deleted volume successfully. Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-40731d8a-d73d-4b77-adea-9b47c3c69302 tempest-VolumesListAdminTestJSON-1746289650 None] Lock "cinder-b1189018-895d-4498-9f22-4e49a559b78f-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:09 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Deleted volume successfully. Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c89dc00-b805-4cb2-b518-90d5a4129136 tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-8bd23340-a0fd-4be1-96e3-022915adee69-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-efd8885e-6616-46d8-9d84-3a4c2a351af5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-efd8885e-6616-46d8-9d84-3a4c2a351af5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-quobyte-efd8885e-6616-46d8-9d84-3a4c2a351af5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-efd8885e-6616-46d8-9d84-3a4c2a351af5" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f6fbe7-77a4-48fb-9d3d-7be6a2206875]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:10 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 Sep 01 12:50:10 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:10 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5" returned: 0 in 0.363s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:10 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5 Sep 01 12:50:10 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:10 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-efd8885e-6616-46d8-9d84-3a4c2a351af5" returned: 0 in 0.265s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-efd8885e-6616-46d8-9d84-3a4c2a351af5" released by "delete_volume" :: held 0.669s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Created reservations ['a783e936-ddf5-4fd6-949a-25173cde56ba', '2f363ec8-c06f-4ff7-a94c-bd32425914a3', 'a96c3433-0aa8-4c49-a59e-e49c65c07ae0', '871ebce3-7689-4ae1-964c-e6b7822c1981'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:10 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:10 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:11 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.257s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Deleted volume successfully. Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-aa1d0349-4967-46e5-81f9-23dca5b9cd5d tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-efd8885e-6616-46d8-9d84-3a4c2a351af5-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-9822d901-fcd7-44f8-8481-8234034b9c34-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-9822d901-fcd7-44f8-8481-8234034b9c34-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "cinder-quobyte-9822d901-fcd7-44f8-8481-8234034b9c34" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-9822d901-fcd7-44f8-8481-8234034b9c34" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9f594-6e52-492e-bcd8-2603d107ec78]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:11 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 Sep 01 12:50:11 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:11 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34" returned: 0 in 0.369s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:11 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34 Sep 01 12:50:11 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:11 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9822d901-fcd7-44f8-8481-8234034b9c34" returned: 0 in 0.252s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-quobyte-9822d901-fcd7-44f8-8481-8234034b9c34" released by "delete_volume" :: held 0.659s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Created reservations ['465d3fff-265f-411f-a75e-7b36dac2d229', 'a47222b9-887b-4a93-80ca-9be3dfd2ca2c', '7410d0b9-0183-427c-8920-cae7fb75de00', 'c8be3c10-f020-49f8-bd5d-2248f57e36c8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:11 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:11 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:12 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.251s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:12 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Deleted volume successfully. Sep 01 12:50:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2770d550-4c2c-4696-9fac-20d6fcd0293b tempest-VolumesListAdminTestJSON-108937354 None] Lock "cinder-9822d901-fcd7-44f8-8481-8234034b9c34-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Flow 'volume_create_manager' (e0b0e659-99a6-4f96-9010-35f540290982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d5569d-88ec-478e-97db-90378d1b9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d5569d-88ec-478e-97db-90378d1b9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1339556135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f3416-933b-422c-823e-37ae5649e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa50239adea4a0e9e06a5bf0e84a61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:17Z,use_quota=True,user_id='ed0e3b5d9b464cdcab77d97753dda8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721085cd-0046-4f8c-85aa-62d56ce58004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721085cd-0046-4f8c-85aa-62d56ce58004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3859185a-b186-40ce-8906-64748b69b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3859185a-b186-40ce-8906-64748b69b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858f3416-933b-422c-823e-37ae5649e613', 'volume_name': 'volume-858f3416-933b-422c-823e-37ae5649e613', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334ab24b-e55c-4a7b-85b5-42808fc35e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334ab24b-e55c-4a7b-85b5-42808fc35e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1993b703-505e-4b01-8458-64eabbe11594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Volume 858f3416-933b-422c-823e-37ae5649e613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858f3416-933b-422c-823e-37ae5649e613', 'volume_size': 1} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1339556135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f3416-933b-422c-823e-37ae5649e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa50239adea4a0e9e06a5bf0e84a61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:17Z,use_quota=True,user_id='ed0e3b5d9b464cdcab77d97753dda8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Creating volume 858f3416-933b-422c-823e-37ae5649e613 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:17 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:17 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 1073741824 Sep 01 12:50:17 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:18 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 1073741824" returned: 0 in 0.467s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:18 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 Sep 01 12:50:18 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:18 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1993b703-505e-4b01-8458-64eabbe11594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858f3416-933b-422c-823e-37ae5649e613', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644ea5a0-ab01-4f59-9b0e-fd1c7ac11687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Volume volume-858f3416-933b-422c-823e-37ae5649e613 (858f3416-933b-422c-823e-37ae5649e613): created successfully Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644ea5a0-ab01-4f59-9b0e-fd1c7ac11687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Flow 'volume_create_manager' (e0b0e659-99a6-4f96-9010-35f540290982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c464d30b-e563-4cc2-bbda-ecb6cb4c3e59 tempest-AbsoluteLimitsTests-124946124 None] Created volume successfully. Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Acquiring lock "cinder-858f3416-933b-422c-823e-37ae5649e613-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "cinder-858f3416-933b-422c-823e-37ae5649e613-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Acquiring lock "cinder-quobyte-858f3416-933b-422c-823e-37ae5649e613" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "cinder-quobyte-858f3416-933b-422c-823e-37ae5649e613" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[740e9ff5-bbf7-42d6-a97f-9ea52445df31]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:18 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 Sep 01 12:50:18 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:19 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613" returned: 0 in 0.433s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:19 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613 Sep 01 12:50:19 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:19 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-858f3416-933b-422c-823e-37ae5649e613" returned: 0 in 0.280s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "cinder-quobyte-858f3416-933b-422c-823e-37ae5649e613" released by "delete_volume" :: held 0.759s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Created reservations ['9073f2d0-5997-46a2-97bf-b803cac9b047', '325a3d05-b500-483c-80d6-73b9f45e055d', '5ad0aa0e-e408-47ef-9a2f-f3ada44d743c', '69d5f877-e5a9-4700-83bb-d279c232060d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:19 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:19 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:19 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.278s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Deleted volume successfully. Sep 01 12:50:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-32ff3ff5-cc7c-47fe-8628-c0eddfb09554 tempest-AbsoluteLimitsTests-124946124 None] Lock "cinder-858f3416-933b-422c-823e-37ae5649e613-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:21 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-4a4ceeee-ffcf-4b9e-9ede-f488f0da4dc4 req-2f814d7f-b96b-4007-a93b-294052777e99 tempest-TestShelveInstance-353328884 None] Terminate volume connection completed successfully. Sep 01 12:50:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-4a4ceeee-ffcf-4b9e-9ede-f488f0da4dc4 req-2f814d7f-b96b-4007-a93b-294052777e99 tempest-TestShelveInstance-353328884 None] Deleting attachment 1aa671f1-595a-44a5-a454-4d7ee9ed9def. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:50:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-be2a168a-f79f-410c-92b9-e86837dc75fd req-05b9b24d-4a44-489c-9c44-356015bf7143 tempest-TestShelveInstance-353328884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-be2a168a-f79f-410c-92b9-e86837dc75fd req-05b9b24d-4a44-489c-9c44-356015bf7143 tempest-TestShelveInstance-353328884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-be2a168a-f79f-410c-92b9-e86837dc75fd req-05b9b24d-4a44-489c-9c44-356015bf7143 tempest-TestShelveInstance-353328884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-be2a168a-f79f-410c-92b9-e86837dc75fd req-05b9b24d-4a44-489c-9c44-356015bf7143 tempest-TestShelveInstance-353328884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a29befbd-8452-40d8-b81f-a7b50ee6c9e3', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:50:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-be2a168a-f79f-410c-92b9-e86837dc75fd req-05b9b24d-4a44-489c-9c44-356015bf7143 tempest-TestShelveInstance-353328884 None] attachment_update completed successfully. Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Flow 'volume_create_manager' (b3dbe7f5-117c-4a17-9bff-b8a7cb03edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df797ed3-4a1b-45d7-af8d-0abea29922e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df797ed3-4a1b-45d7-af8d-0abea29922e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-244482020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35854a0-3dad-4ae8-bbef-139bb4b3c90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11ce70ff06b4c71837374606ef2a3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:25Z,use_quota=True,user_id='f3efff195dc549a297052f1ed1f02cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bc2ce8-47ca-4297-96e6-afd34549c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bc2ce8-47ca-4297-96e6-afd34549c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8164eab-bac2-4247-bc6a-41578c71bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8164eab-bac2-4247-bc6a-41578c71bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd35854a0-3dad-4ae8-bbef-139bb4b3c90b', 'volume_name': 'volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8acca9-3a49-4c78-baa3-43e628f951d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8acca9-3a49-4c78-baa3-43e628f951d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3e01ff-a256-4970-b16a-0f1b3d2231ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Volume d35854a0-3dad-4ae8-bbef-139bb4b3c90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b', 'volume_size': 1} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-244482020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35854a0-3dad-4ae8-bbef-139bb4b3c90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11ce70ff06b4c71837374606ef2a3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:25Z,use_quota=True,user_id='f3efff195dc549a297052f1ed1f02cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Creating volume d35854a0-3dad-4ae8-bbef-139bb4b3c90b {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:25 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b 1073741824 Sep 01 12:50:25 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:25 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b 1073741824" returned: 0 in 0.526s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:25 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b Sep 01 12:50:25 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:25 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" returned: 0 in 0.291s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3e01ff-a256-4970-b16a-0f1b3d2231ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8b7eea-93a8-47f7-9428-019915472a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:25 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Volume volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b (d35854a0-3dad-4ae8-bbef-139bb4b3c90b): created successfully Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8b7eea-93a8-47f7-9428-019915472a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Flow 'volume_create_manager' (b3dbe7f5-117c-4a17-9bff-b8a7cb03edad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f9acefd1-88f9-4406-8810-db3bfa91a7ec tempest-VolumesMetadataTest-1923286943 None] Created volume successfully. Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:26 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:26 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:27 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:50:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:50:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Acquiring lock "cinder-d35854a0-3dad-4ae8-bbef-139bb4b3c90b-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "cinder-d35854a0-3dad-4ae8-bbef-139bb4b3c90b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Acquiring lock "cinder-quobyte-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "cinder-quobyte-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d297fdea-b8df-410e-98a4-7c06e0bd216a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:28 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b Sep 01 12:50:28 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:28 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:28 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b Sep 01 12:50:28 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:28 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "cinder-quobyte-d35854a0-3dad-4ae8-bbef-139bb4b3c90b" released by "delete_volume" :: held 0.772s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:28 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Created reservations ['9ccfd4eb-ba8c-44a9-992b-9f78c523d537', '72e8c205-cce2-4261-a707-e4cda55e5425', 'd9c1542c-ff8f-4c3e-a8cf-9e1a50864af6', '471e7aae-f171-44e0-bcdb-31049ea71e2b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:29 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:29 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:29 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.372s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Deleted volume successfully. Sep 01 12:50:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-664bcc3f-9a04-4d96-b93f-8a8dd3a85f8e tempest-VolumesMetadataTest-1923286943 None] Lock "cinder-d35854a0-3dad-4ae8-bbef-139bb4b3c90b-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (5a7a9414-7c6a-4739-bfa6-34b1fec24c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8522aa-ef38-4674-803a-630ae86b9e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8522aa-ef38-4674-803a-630ae86b9e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-969501841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2e3847-5b57-4f86-b87c-79587b55c0b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:32Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c3d97-9bfc-4354-a90c-db0580b25b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c3d97-9bfc-4354-a90c-db0580b25b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371befe-3f56-4d5a-bd09-f29279feb865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371befe-3f56-4d5a-bd09-f29279feb865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2e3847-5b57-4f86-b87c-79587b55c0b7', 'volume_name': 'volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef79e62-54e0-4b73-89ad-9c984dfa9fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef79e62-54e0-4b73-89ad-9c984dfa9fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ef4c48-4a34-4353-ae50-87d48648f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Volume 5e2e3847-5b57-4f86-b87c-79587b55c0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7', 'volume_size': 1} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-969501841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2e3847-5b57-4f86-b87c-79587b55c0b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:32Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Creating volume 5e2e3847-5b57-4f86-b87c-79587b55c0b7 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:32 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:32 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 1073741824 Sep 01 12:50:32 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:33 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 1073741824" returned: 0 in 0.464s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:33 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 Sep 01 12:50:33 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:33 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ef4c48-4a34-4353-ae50-87d48648f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad6d165-8e8d-4495-8b75-790fbb6c81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:33 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Volume volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 (5e2e3847-5b57-4f86-b87c-79587b55c0b7): created successfully Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad6d165-8e8d-4495-8b75-790fbb6c81e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (5a7a9414-7c6a-4739-bfa6-34b1fec24c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-31b9516e-0fdf-4d5a-ad27-3339e12fb6d1 tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (0fe87027-b675-482e-bdfc-0fbbf9972f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660c7d66-d2fe-48d4-9e5b-4ceeadcbaf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660c7d66-d2fe-48d4-9e5b-4ceeadcbaf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-37258783',display_name='tempest-VolumesGetTest-Volume-1845827461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e58a15c-3262-4918-ae71-ddbeb77c08db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:35Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5471c3e-d71c-45d0-bb1f-c82adaffa27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5471c3e-d71c-45d0-bb1f-c82adaffa27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291302b2-c439-4d21-b231-0ee022ef9925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291302b2-c439-4d21-b231-0ee022ef9925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e58a15c-3262-4918-ae71-ddbeb77c08db', 'volume_name': 'volume-5e58a15c-3262-4918-ae71-ddbeb77c08db', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0735a9-3cdf-4c1b-a957-5766c89e16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0735a9-3cdf-4c1b-a957-5766c89e16b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4f104f-8011-48cc-850b-88d8eac07f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:35 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Volume 5e58a15c-3262-4918-ae71-ddbeb77c08db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e58a15c-3262-4918-ae71-ddbeb77c08db', 'volume_size': 1} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-37258783',display_name='tempest-VolumesGetTest-Volume-1845827461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e58a15c-3262-4918-ae71-ddbeb77c08db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:35Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Creating volume 5e58a15c-3262-4918-ae71-ddbeb77c08db {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:35 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:35 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db 1073741824 Sep 01 12:50:35 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:35 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db 1073741824" returned: 0 in 0.418s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:35 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db Sep 01 12:50:35 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:36 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db" returned: 0 in 0.265s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4f104f-8011-48cc-850b-88d8eac07f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e58a15c-3262-4918-ae71-ddbeb77c08db', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93924da7-ab89-4fa8-81b9-27a54df174e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Volume volume-5e58a15c-3262-4918-ae71-ddbeb77c08db (5e58a15c-3262-4918-ae71-ddbeb77c08db): created successfully Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93924da7-ab89-4fa8-81b9-27a54df174e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (0fe87027-b675-482e-bdfc-0fbbf9972f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-722d6e68-c0ad-4adc-9861-0436d7798c5d tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-5e58a15c-3262-4918-ae71-ddbeb77c08db-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "cinder-5e58a15c-3262-4918-ae71-ddbeb77c08db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-5e58a15c-3262-4918-ae71-ddbeb77c08db" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5e58a15c-3262-4918-ae71-ddbeb77c08db" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7892a1b3-9dd4-4dc7-9481-efd4d5db18c4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:36 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db Sep 01 12:50:36 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:36 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db" returned: 0 in 0.418s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:37 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db Sep 01 12:50:37 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:37 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e58a15c-3262-4918-ae71-ddbeb77c08db" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5e58a15c-3262-4918-ae71-ddbeb77c08db" released by "delete_volume" :: held 0.711s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Created reservations ['9120d9f0-82fa-4abc-9d3a-aeb2e68a3349', '769ee310-5367-4a06-81a6-9a1779c4b9da', 'c13e79e9-70df-480b-a813-1465bb006805', '70418509-ef1c-4bcf-b73b-03cd9e9b3039'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:37 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:37 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-5e2e3847-5b57-4f86-b87c-79587b55c0b7-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:37 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "cinder-5e2e3847-5b57-4f86-b87c-79587b55c0b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3ba08d62-25e1-47cd-a673-ae006d4a9608 tempest-VolumesGetTest-354520950 None] Lock "cinder-5e58a15c-3262-4918-ae71-ddbeb77c08db-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-5e2e3847-5b57-4f86-b87c-79587b55c0b7" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5e2e3847-5b57-4f86-b87c-79587b55c0b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd253fa-1e1f-4519-8a99-9723022cfc7a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:37 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 Sep 01 12:50:37 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:38 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7" returned: 0 in 0.370s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:38 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7 Sep 01 12:50:38 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:38 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5e2e3847-5b57-4f86-b87c-79587b55c0b7" returned: 0 in 0.257s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5e2e3847-5b57-4f86-b87c-79587b55c0b7" released by "delete_volume" :: held 0.672s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Created reservations ['4e5c48ed-e495-43a0-951c-8b86e287864e', '6b259dd8-9850-4063-ab3a-5356d1068d9d', '6d25017e-290d-429e-a2da-49eafc94bda0', '565ef519-4833-4b7d-aa7c-2f637b947c1a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:38 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:38 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:38 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.265s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:50:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-67d5c067-32dd-4c10-9f89-a3bf750954e2 tempest-VolumesGetTest-354520950 None] Lock "cinder-5e2e3847-5b57-4f86-b87c-79587b55c0b7-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (bc8ecbf9-898d-4ee0-9b96-11aa98b62da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7106a7b2-a7a3-4af9-a7ee-5f237c4d1961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7106a7b2-a7a3-4af9-a7ee-5f237c4d1961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-501950807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af0a516-194d-4417-bb75-cd20a8e754d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:39Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dc5873-4d85-4924-a28a-46601b2f0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4dc5873-4d85-4924-a28a-46601b2f0761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5460da5-5af4-4bfc-aa41-4eb10a7f31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5460da5-5af4-4bfc-aa41-4eb10a7f31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af0a516-194d-4417-bb75-cd20a8e754d3', 'volume_name': 'volume-5af0a516-194d-4417-bb75-cd20a8e754d3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99934a-b14a-4891-ae50-972db9b75d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99934a-b14a-4891-ae50-972db9b75d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd54b5a4-9b1d-4d15-9df1-0b4e931357f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Volume 5af0a516-194d-4417-bb75-cd20a8e754d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af0a516-194d-4417-bb75-cd20a8e754d3', 'volume_size': 1} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-501950807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af0a516-194d-4417-bb75-cd20a8e754d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:39Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Creating volume 5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:39 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:39 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 1073741824 Sep 01 12:50:39 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:39 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 1073741824" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:40 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:40 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:40 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd54b5a4-9b1d-4d15-9df1-0b4e931357f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af0a516-194d-4417-bb75-cd20a8e754d3', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccff14b-f797-414a-a01e-8b8fcce76708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Volume volume-5af0a516-194d-4417-bb75-cd20a8e754d3 (5af0a516-194d-4417-bb75-cd20a8e754d3): created successfully Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccff14b-f797-414a-a01e-8b8fcce76708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (bc8ecbf9-898d-4ee0-9b96-11aa98b62da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f74bafc0-0d39-46b9-87cb-38efe99e4e61 tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:50:40 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (1703abcc-fdfa-45fe-b135-527390383a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c295e-6c14-4231-893c-428b991a7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c295e-6c14-4231-893c-428b991a7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1742322596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5af0a516-194d-4417-bb75-cd20a8e754d3,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:41Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b3c3ca-6885-4bcc-88da-76cca0b26015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b3c3ca-6885-4bcc-88da-76cca0b26015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf52c4-1c10-416b-8892-5dde6d5d0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf52c4-1c10-416b-8892-5dde6d5d0cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a', 'volume_name': 'volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a', 'volume_size': 1, 'source_volid': '5af0a516-194d-4417-bb75-cd20a8e754d3', 'source_volstatus': 'available'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bbc321-cdf7-491d-93d9-d8b88de82d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76bbc321-cdf7-491d-93d9-d8b88de82d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1e61b1-611d-48ff-ad8d-e105be755302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:41 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Volume 31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a', 'volume_size': 1, 'source_volid': '5af0a516-194d-4417-bb75-cd20a8e754d3', 'source_volstatus': 'available'} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:41 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Cloning volume 5af0a516-194d-4417-bb75-cd20a8e754d3 to volume 31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Creating offline snapshot c321304d-557a-405f-b47b-aef2c8b8d594 of volume 5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04bb37e-b4bb-4aca-a1b6-114592adb581]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:41 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:41 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:41 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.387s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:41 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 1G Sep 01 12:50:41 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:42 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 1G" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af0a516-194d-4417-bb75-cd20a8e754d3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:42 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af0a516-194d-4417-bb75-cd20a8e754d3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:42 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:42 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5af0a516-194d-4417-bb75-cd20a8e754d3 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.328s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:42 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 is being set with open permissions: ugo+rw Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:42 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:42 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:42 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:42 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info Sep 01 12:50:42 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:42 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:42 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info is being set with open permissions: ugo+rw Sep 01 12:50:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:42 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info Sep 01 12:50:42 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:43 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.info" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] snapshot: c321304d-557a-405f-b47b-aef2c8b8d594, volume: 31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[616897bd-fed9-4bb5-8cbd-f8ac08ee6bc6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:43 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:43 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:43 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5af0a516-194d-4417-bb75-cd20a8e754d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[331f2400-8ba2-487f-bd52-ceb856126d14]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:43 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:43 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:43 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:50:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:44 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a Sep 01 12:50:44 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:48 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" returned: 0 in 4.478s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:50:48 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Converted 1024.00 MB image at 228.62 MB/s Sep 01 12:50:48 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a is being set with open permissions: ugo+rw Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:48 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a Sep 01 12:50:48 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:48 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" returned: 0 in 0.241s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" released by "_copy_volume_from_snapshot" :: held 5.518s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-c321304d-557a-405f-b47b-aef2c8b8d594" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-c321304d-557a-405f-b47b-aef2c8b8d594" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Deleting offline snapshot c321304d-557a-405f-b47b-aef2c8b8d594 of volume 5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] snapshot_file for this snap is: volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f70582-20fb-4d84-82f5-6d18b2b4bd2b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:48 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:48 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:49 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.394s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5af0a516-194d-4417-bb75-cd20a8e754d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[40898095-7abe-429b-87c6-d6adbe3192ef]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:49 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:49 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:49 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.570s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:49 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:49 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:50 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:50 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594 Sep 01 12:50:50 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:50 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3.c321304d-557a-405f-b47b-aef2c8b8d594" returned: 0 in 0.264s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-c321304d-557a-405f-b47b-aef2c8b8d594" released by "_delete_snapshot" :: held 1.691s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.363s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1e61b1-611d-48ff-ad8d-e105be755302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a', 'volume_size': 1, 'source_volid': '5af0a516-194d-4417-bb75-cd20a8e754d3', 'source_volstatus': 'available'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe13fb2-ce47-4dc6-b1cb-94ddf0a55f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:50 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Volume volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a (31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a): created successfully Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe13fb2-ce47-4dc6-b1cb-94ddf0a55f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:50 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (1703abcc-fdfa-45fe-b135-527390383a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e3aa5c89-0d2f-41f7-9fb0-1fc2c34a220c tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (56cde285-e8e8-4abe-bc68-1d8841979393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea33afc7-5174-4b0a-b4e5-5395db2f7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea33afc7-5174-4b0a-b4e5-5395db2f7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-360499970',display_name='tempest-VolumesGetTest-Volume-1805160859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:51Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e073946-65d3-4fab-8ed5-80eb2e2e1358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e073946-65d3-4fab-8ed5-80eb2e2e1358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92ced3-3e18-4dd1-9118-4f016623a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92ced3-3e18-4dd1-9118-4f016623a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2', 'volume_name': 'volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d506358-f3ad-4398-8cf1-e52a0262215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d506358-f3ad-4398-8cf1-e52a0262215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba6dd21-d096-40dc-84d0-b5e6542401f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:51 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Volume a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2', 'volume_size': 1} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-360499970',display_name='tempest-VolumesGetTest-Volume-1805160859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:51Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Creating volume a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:51 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:51 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 1073741824 Sep 01 12:50:51 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:51 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 1073741824" returned: 0 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:52 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 Sep 01 12:50:52 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:52 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba6dd21-d096-40dc-84d0-b5e6542401f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f879795d-8da6-40b2-a08a-5020b0c6c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Volume volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 (a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2): created successfully Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f879795d-8da6-40b2-a08a-5020b0c6c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (56cde285-e8e8-4abe-bc68-1d8841979393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1ddb023f-a871-4710-a7a7-6ead5d55d3cf tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "cinder-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[df93915d-279a-4c50-ba7c-eda806837052]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:52 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 Sep 01 12:50:52 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:53 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" returned: 0 in 0.383s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:53 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2 Sep 01 12:50:53 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:53 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2" released by "delete_volume" :: held 0.794s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Created reservations ['afe19a7c-76ad-44e3-83f3-99d43a30093b', '3cb11a73-a77d-4e34-8036-bbff1537ad29', '50387b7b-9c73-409a-be88-4ea324c4f626', '6aea2f06-f0f5-419b-8d89-5c35e317a9a3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:53 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:53 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:53 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "cinder-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.341s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:53 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-20fc9f76-dcda-46f1-b62c-48f0f95de93a tempest-VolumesGetTest-354520950 None] Lock "cinder-a8fd5c9c-4847-44b3-aa0a-7d4c1f7ed8c2-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" acquired by "delete_volume" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b19fdc7-2217-420c-821d-2bb32ed8a100]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:54 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a Sep 01 12:50:54 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:54 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:54 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a Sep 01 12:50:54 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:54 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a" released by "delete_volume" :: held 0.935s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Created reservations ['9e9dc52d-ae0d-4d8e-b69c-c70465ff5db0', 'cb167128-c33c-49aa-87f7-e2ccc7aef5ee', '30610b68-f762-49d5-b3ca-2952219d60de', '6e01a1a6-0871-4b2f-a0db-ce7ed266f4d4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-521057fa-e5da-4cf9-ba76-60f4f03a50e3 tempest-TestShelveInstance-353328884 None] Terminate volume connection completed successfully. Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-521057fa-e5da-4cf9-ba76-60f4f03a50e3 tempest-TestShelveInstance-353328884 None] Deleting attachment a29befbd-8452-40d8-b81f-a7b50ee6c9e3. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:55 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:55 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Acquiring lock "cinder-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "cinder-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Acquiring lock "cinder-quobyte-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "cinder-quobyte-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[240c14bd-d8ad-43c3-992f-5f465128e202]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:55 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7f9e069-20b2-4797-b7a7-9b19ea12d029 tempest-VolumesGetTest-354520950 None] Lock "cinder-31a455d0-1dfe-45f7-81bf-0bb02ebbfa7a-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:55 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 Sep 01 12:50:55 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:55 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:55 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3 Sep 01 12:50:55 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:56 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "cinder-quobyte-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3" released by "delete_volume" :: held 0.759s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.quota [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Created reservations ['aa5e891f-5f0c-407f-a9a7-28b41a44e5d8', 'bf49d7c9-ac96-44d9-af0b-5039a7067264', '89a9c303-d57a-4cb6-9dba-8e03baeced0e', '2927201f-fc26-4890-99a9-4f43df1b0cf8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-5af0a516-194d-4417-bb75-cd20a8e754d3-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "cinder-5af0a516-194d-4417-bb75-cd20a8e754d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:56 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:56 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-5af0a516-194d-4417-bb75-cd20a8e754d3" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5af0a516-194d-4417-bb75-cd20a8e754d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[255371a8-ee51-4897-955f-244ab2777feb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:56 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:56 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:56 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.manager [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Deleted volume successfully. Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [req-0329d0f9-792c-4494-843f-e28847d8fa40 req-33ec0dcd-6f73-4718-8f6a-244a95480578 tempest-TestShelveInstance-353328884 None] Lock "cinder-e199c1bc-66f3-49b2-9c29-07f85bf1b7e3-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:56 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.462s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:56 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3 Sep 01 12:50:56 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:57 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5af0a516-194d-4417-bb75-cd20a8e754d3" returned: 0 in 0.275s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-5af0a516-194d-4417-bb75-cd20a8e754d3" released by "delete_volume" :: held 0.803s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Created reservations ['8ffc5ffb-01db-40bd-a32b-bd3c2a7ddd42', '7f3555d3-b475-459a-be4c-0d5ab6284924', '981e5d76-dcbc-4aac-8c53-fe1b10f971ef', '23ec3036-c6f1-49d0-bf71-1e770b644f97'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:57 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:50:57 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:57 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:50:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=90,cinder:UPDATE=136,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:50:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-42418a1d-b414-492e-b855-0a0fca67deb7 tempest-VolumesGetTest-354520950 None] Lock "cinder-5af0a516-194d-4417-bb75-cd20a8e754d3-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=99,cinder:UPDATE=129,cinder:INSERT=30,cinder:DELETE=16 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (ea5d7cc5-f151-4e7f-82a2-d0daec6ee86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dae418-ce66-4a4b-8898-caf5f8d2f6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dae418-ce66-4a4b-8898-caf5f8d2f6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1044684727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b684d-0dec-4adb-a658-23bffdc3ee34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:58Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fdc80b-0462-46d7-9f34-477505113558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fdc80b-0462-46d7-9f34-477505113558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec416733-406d-478a-badd-18caea77d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec416733-406d-478a-badd-18caea77d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d2b684d-0dec-4adb-a658-23bffdc3ee34', 'volume_name': 'volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b8b303-0a82-42ec-92b7-0cdc03d35c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b8b303-0a82-42ec-92b7-0cdc03d35c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79c5a38-f228-453c-b484-16e6cfd9ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:50:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 12:50:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Trying to clone 4d2b684d-0dec-4adb-a658-23bffdc3ee34 from image 903fc775-9c21-408b-9650-9b60d3b1eb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:50:59 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Image download 20.69 MB at 20.69 MB/s Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf80a90-7740-4921-8450-69a6f3a94e75]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:59 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD Sep 01 12:50:59 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:59 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 is fetched for user 950513f1b5144a579f89a6ad4400d5d3. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[850c3f3f-b233-4dee-95f6-3f02a93085b2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:59 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD Sep 01 12:50:59 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:50:59 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1044684727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2b684d-0dec-4adb-a658-23bffdc3ee34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:50:58Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Creating volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:50:59 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:50:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:50:59 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1073741824 Sep 01 12:50:59 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:00 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1073741824" returned: 0 in 0.489s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:00 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 Sep 01 12:51:00 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:00 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Attempting download of 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c204e-c232-4e7c-8fe3-31c4b701b876]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:00 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb Sep 01 12:51:00 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:01 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:01 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb Sep 01 12:51:01 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:01 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb" returned: 1 in 0.348s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_903fc775-9c21-408b-9650-9b60d3b1eb91_7njc4neb' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e30e414-cb8e-4889-a13e-cf18a18ceb18]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:01 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD Sep 01 12:51:01 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:01 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] 903fc775-9c21-408b-9650-9b60d3b1eb91 was qcow2, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:51:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:01 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 Sep 01 12:51:01 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:03 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34" returned: 0 in 1.793s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:03 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_903fc775-9c21-408b-9650-9b60d3b1eb91_kccwfrobdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:51:03 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Converted 112.00 MB image at 62.41 MB/s Sep 01 12:51:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:03 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1G Sep 01 12:51:03 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:04 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 1G" returned: 0 in 0.375s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Downloaded image 903fc775-9c21-408b-9650-9b60d3b1eb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}])) to volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Temporary image 903fc775-9c21-408b-9650-9b60d3b1eb91 for user 950513f1b5144a579f89a6ad4400d5d3 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Marking volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Copying metadata from image 903fc775-9c21-408b-9650-9b60d3b1eb91 to 4d2b684d-0dec-4adb-a658-23bffdc3ee34. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Creating volume glance metadata for volume 4d2b684d-0dec-4adb-a658-23bffdc3ee34 backed by image 903fc775-9c21-408b-9650-9b60d3b1eb91 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79c5a38-f228-453c-b484-16e6cfd9ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34', 'volume_size': 1, 'image_id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/903fc775-9c21-408b-9650-9b60d3b1eb91', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5ae8dbbeb7c4f488c9a6aeaf0c4b835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '903fc775-9c21-408b-9650-9b60d3b1eb91', 'created_at': datetime.datetime(2026, 9, 1, 10, 29, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/903fc775-9c21-408b-9650-9b60d3b1eb91/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45edda48-8ddd-410c-b445-e78171127e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:04 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Volume volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 (4d2b684d-0dec-4adb-a658-23bffdc3ee34): created successfully Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45edda48-8ddd-410c-b445-e78171127e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:04 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (ea5d7cc5-f151-4e7f-82a2-d0daec6ee86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8a9d3514-916c-4383-989c-f96d6787dbaa tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (252ef963-6518-47f9-b955-3d63dea6596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21173c22-c0c7-4e73-93cd-f1695debf9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21173c22-c0c7-4e73-93cd-f1695debf9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-75808766',display_name='tempest-VolumesGetTest-Volume-654958920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf18a45-c6aa-45f8-a8f0-4c7acf8ab190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:05Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26d860e-59b3-49d4-b877-94e7923a52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26d860e-59b3-49d4-b877-94e7923a52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56cba05-7812-4263-b57c-0bd5cc8e875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56cba05-7812-4263-b57c-0bd5cc8e875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf18a45-c6aa-45f8-a8f0-4c7acf8ab190', 'volume_name': 'volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01488608-fce1-4b6d-89b0-fd2e8f742eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01488608-fce1-4b6d-89b0-fd2e8f742eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6ebfa7-9e6a-4343-b5ca-f592994f48f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:05 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Volume daf18a45-c6aa-45f8-a8f0-4c7acf8ab190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190', 'volume_size': 1} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-75808766',display_name='tempest-VolumesGetTest-Volume-654958920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf18a45-c6aa-45f8-a8f0-4c7acf8ab190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03a754c0d0e41c780c59a29ffea39f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:05Z,use_quota=True,user_id='950513f1b5144a579f89a6ad4400d5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Creating volume daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:51:05 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:51:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:05 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 1073741824 Sep 01 12:51:05 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:06 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 1073741824" returned: 0 in 0.503s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:06 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 Sep 01 12:51:06 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:06 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6ebfa7-9e6a-4343-b5ca-f592994f48f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd3c0dc-2801-4993-a63e-2d2e589c5518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Volume volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 (daf18a45-c6aa-45f8-a8f0-4c7acf8ab190): created successfully Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd3c0dc-2801-4993-a63e-2d2e589c5518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Flow 'volume_create_manager' (252ef963-6518-47f9-b955-3d63dea6596a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ce906634-a86e-4afa-96ab-9aea86729e1d tempest-VolumesGetTest-354520950 None] Created volume successfully. Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "cinder-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679e387-64ce-4d3b-87a5-88b7c623d8df]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:08 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 Sep 01 12:51:08 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:08 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:08 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190 Sep 01 12:51:08 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:08 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190" released by "delete_volume" :: held 0.733s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Created reservations ['087f463a-e422-485b-8cfe-ca764097b9e3', '72abaa67-ff39-45e2-9526-a226b2e40bb0', 'a9c9f590-a92c-43b5-a34b-03706fd7848f', '063a8d65-f790-4b9e-8a3b-3b0c880b4950'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:08 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:51:08 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:09 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.287s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:51:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-4d2b684d-0dec-4adb-a658-23bffdc3ee34-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-294b926f-a8a6-4664-bf6c-36024ce18a7f tempest-VolumesGetTest-354520950 None] Lock "cinder-daf18a45-c6aa-45f8-a8f0-4c7acf8ab190-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "cinder-4d2b684d-0dec-4adb-a658-23bffdc3ee34-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Acquiring lock "cinder-quobyte-4d2b684d-0dec-4adb-a658-23bffdc3ee34" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-4d2b684d-0dec-4adb-a658-23bffdc3ee34" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d2c533-d7d3-457f-9f30-2ce5da369348]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:09 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 Sep 01 12:51:09 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:09 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34" returned: 0 in 0.403s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:09 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34 Sep 01 12:51:09 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:09 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4d2b684d-0dec-4adb-a658-23bffdc3ee34" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "cinder-quobyte-4d2b684d-0dec-4adb-a658-23bffdc3ee34" released by "delete_volume" :: held 0.714s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Created reservations ['ec0a1824-9678-4f26-8df3-59bb3430283f', '4edf6dde-dfba-4fd3-84f6-c512c301ba75', 'bb6acd8c-9a0b-4b42-9274-e78fb0603cb0', 'f570c06d-7375-40b8-bb84-20f58921108a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:10 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:51:10 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:10 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:51:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Deleted volume successfully. Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-08dabf1d-55ac-44d7-b195-42440000ce10 tempest-VolumesGetTest-354520950 None] Lock "cinder-4d2b684d-0dec-4adb-a658-23bffdc3ee34-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Flow 'volume_create_manager' (97db1008-f8be-46cc-b3b5-49eadadeba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490a2542-a0d7-4fce-8542-90278f975523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490a2542-a0d7-4fce-8542-90278f975523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-853738830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883d803b-e3ca-4873-8e52-83c33d7227ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd862bee08c246228e4f74aab062ee1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:10Z,use_quota=True,user_id='7c72195d73f04dd4bba6a5dcee387fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f2eb4-40e0-4d63-9093-9f2c2f73973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f2eb4-40e0-4d63-9093-9f2c2f73973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25965ae4-f34d-4f3c-a713-a5c1efbeb5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25965ae4-f34d-4f3c-a713-a5c1efbeb5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883d803b-e3ca-4873-8e52-83c33d7227ff', 'volume_name': 'volume-883d803b-e3ca-4873-8e52-83c33d7227ff', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30817f2a-08c5-4f64-9126-df69253e155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30817f2a-08c5-4f64-9126-df69253e155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe05b838-3edf-41c8-8c0b-c2786edc7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Volume 883d803b-e3ca-4873-8e52-83c33d7227ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883d803b-e3ca-4873-8e52-83c33d7227ff', 'volume_size': 1} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-853738830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883d803b-e3ca-4873-8e52-83c33d7227ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd862bee08c246228e4f74aab062ee1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:10Z,use_quota=True,user_id='7c72195d73f04dd4bba6a5dcee387fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Creating volume 883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:51:10 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:10 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff 1073741824 Sep 01 12:51:10 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:10 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff 1073741824" returned: 0 in 0.426s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:10 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:10 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:11 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe05b838-3edf-41c8-8c0b-c2786edc7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883d803b-e3ca-4873-8e52-83c33d7227ff', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2452b033-8a60-4d40-bf9e-70496408c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Volume volume-883d803b-e3ca-4873-8e52-83c33d7227ff (883d803b-e3ca-4873-8e52-83c33d7227ff): created successfully Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2452b033-8a60-4d40-bf9e-70496408c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Flow 'volume_create_manager' (97db1008-f8be-46cc-b3b5-49eadadeba6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bd7d7c69-28f4-45a7-b4a0-8a03ff1a8dab tempest-VolumeDependencyTests-535722434 None] Created volume successfully. Sep 01 12:51:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Creating offline snapshot b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 of volume 883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:51:12 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d12f39-ecf8-44e7-8fa6-225c74498693]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:12 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:12 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:13 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:13 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 1G Sep 01 12:51:13 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:13 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 1G" returned: 0 in 0.466s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883d803b-e3ca-4873-8e52-83c33d7227ff -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:13 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883d803b-e3ca-4873-8e52-83c33d7227ff -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:13 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:13 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883d803b-e3ca-4873-8e52-83c33d7227ff -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.334s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:13 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 is being set with open permissions: ugo+rw Sep 01 12:51:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:13 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:13 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:14 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:14 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info Sep 01 12:51:14 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:14 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:14 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info is being set with open permissions: ugo+rw Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:14 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info Sep 01 12:51:14 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:14 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.info" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-50484bf0-4c8c-44eb-89dd-6b83c3a12d9b tempest-VolumeDependencyTests-535722434 None] Create snapshot completed successfully Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Flow 'volume_create_manager' (68ac7ff1-4c55-4498-b53f-23133341b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3ddfa3-2fac-45c5-9812-1336be883bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3ddfa3-2fac-45c5-9812-1336be883bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-526482785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62511c9b-a6d9-4177-84e1-4224572b90d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd862bee08c246228e4f74aab062ee1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8cbe729-74c1-45ef-8bc7-6b0c9636bf93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:16Z,use_quota=True,user_id='7c72195d73f04dd4bba6a5dcee387fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17821d9-7e82-4a42-800e-0e984102b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17821d9-7e82-4a42-800e-0e984102b732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285142f3-17ad-42db-a975-6897dda678a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285142f3-17ad-42db-a975-6897dda678a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62511c9b-a6d9-4177-84e1-4224572b90d0', 'volume_name': 'volume-62511c9b-a6d9-4177-84e1-4224572b90d0', 'volume_size': 1, 'snapshot_id': 'b8cbe729-74c1-45ef-8bc7-6b0c9636bf93'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8abcc2-4902-44fc-98d1-c3d37c712f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8abcc2-4902-44fc-98d1-c3d37c712f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a469dc-9e33-4fad-a9ca-8dece35f14f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Volume 62511c9b-a6d9-4177-84e1-4224572b90d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62511c9b-a6d9-4177-84e1-4224572b90d0', 'volume_size': 1, 'snapshot_id': 'b8cbe729-74c1-45ef-8bc7-6b0c9636bf93'} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-62511c9b-a6d9-4177-84e1-4224572b90d0" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-62511c9b-a6d9-4177-84e1-4224572b90d0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Creating volume 62511c9b-a6d9-4177-84e1-4224572b90d0 from snapshot b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] snapshot: b8cbe729-74c1-45ef-8bc7-6b0c9636bf93, volume: 62511c9b-a6d9-4177-84e1-4224572b90d0, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca4209c-6106-471f-b44c-11c432ceecdb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:16 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:16 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:16 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-883d803b-e3ca-4873-8e52-83c33d7227ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb37f0-848f-41a3-8661-3311aa237aaf]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:17 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:17 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:17 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.466s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:51:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:51:17 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:51:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:17 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 Sep 01 12:51:17 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:22 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0" returned: 0 in 5.133s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:51:22 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Converted 1024.00 MB image at 199.43 MB/s Sep 01 12:51:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 is being set with open permissions: ugo+rw Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:22 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 Sep 01 12:51:22 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:22 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" released by "_copy_volume_from_snapshot" :: held 6.391s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-62511c9b-a6d9-4177-84e1-4224572b90d0" released by "_create_volume_from_snapshot" :: held 6.460s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.480s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a469dc-9e33-4fad-a9ca-8dece35f14f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62511c9b-a6d9-4177-84e1-4224572b90d0', 'volume_size': 1, 'snapshot_id': 'b8cbe729-74c1-45ef-8bc7-6b0c9636bf93'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fbb383-51ab-4f24-93bc-f3a209e0446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Volume volume-62511c9b-a6d9-4177-84e1-4224572b90d0 (62511c9b-a6d9-4177-84e1-4224572b90d0): created successfully Sep 01 12:51:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fbb383-51ab-4f24-93bc-f3a209e0446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Flow 'volume_create_manager' (68ac7ff1-4c55-4498-b53f-23133341b24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d3044a5c-2d37-49e5-ba2c-10f89665d60c tempest-VolumeDependencyTests-535722434 None] Created volume successfully. Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Deleting offline snapshot b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 of volume 883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] snapshot_file for this snap is: volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05adbf-da10-4c2f-9e32-def8f210a6b2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:24 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:24 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:24 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.411s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-883d803b-e3ca-4873-8e52-83c33d7227ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff852a1f-9b29-4396-875d-0a9dcaf01ced]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:24 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:24 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:25 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.715s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:25 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:25 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:25 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:25 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93 Sep 01 12:51:25 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:26 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff.b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" returned: 0 in 0.284s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93" released by "_delete_snapshot" :: held 1.968s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" released by "delete_snapshot" :: held 1.995s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Created reservations ['6dc12f8d-6b9a-4a6f-aff8-4c85bd5f6300', '04b62ff7-4d5d-49a6-80f9-2fa496f0fea3', 'c71228ed-38bb-4f35-af97-99a24d623130', '2f336606-74a3-4395-b40a-154aa15e685d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:51:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Delete snapshot completed successfully. Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a14fffea-b800-47ac-bd45-b36442f6597a tempest-VolumeDependencyTests-535722434 None] Lock "cinder-b8cbe729-74c1-45ef-8bc7-6b0c9636bf93-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-883d803b-e3ca-4873-8e52-83c33d7227ff-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "cinder-883d803b-e3ca-4873-8e52-83c33d7227ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c2a105-47f4-42b2-a236-2d66f4818802]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:26 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:26 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:26 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:51:26 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:26 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.430s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:26 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.331s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:51:27 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff Sep 01 12:51:27 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:27 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-883d803b-e3ca-4873-8e52-83c33d7227ff" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-883d803b-e3ca-4873-8e52-83c33d7227ff" released by "delete_volume" :: held 0.769s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Created reservations ['870669a4-fe3e-4c5e-98e5-cab958813203', 'e358533b-5726-43e5-a054-3a4be731da66', '5e12ea3c-b896-4f34-afa9-407cb18e147b', '3f23bbaf-d31d-491c-b0ca-db05473f1d65'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:27 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:51:27 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-62511c9b-a6d9-4177-84e1-4224572b90d0-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "cinder-62511c9b-a6d9-4177-84e1-4224572b90d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Acquiring lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:51:27 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614b579-1fb2-400f-9e1c-be896335ae05]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Deleted volume successfully. Sep 01 12:51:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b806f411-e0ff-4959-9150-9d12638a5e54 tempest-VolumeDependencyTests-535722434 None] Lock "cinder-883d803b-e3ca-4873-8e52-83c33d7227ff-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:27 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 Sep 01 12:51:27 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:28 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0" returned: 0 in 0.405s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:28 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0 Sep 01 12:51:28 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:28 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-62511c9b-a6d9-4177-84e1-4224572b90d0" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "cinder-quobyte-62511c9b-a6d9-4177-84e1-4224572b90d0" released by "delete_volume" :: held 0.712s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Created reservations ['7284160b-ddff-4801-aa59-9dc452019bd6', '7158edba-ff55-445a-a9d4-0f108bdec5d8', '45e8397a-3e98-4980-8dc5-d38ddb4b1f4d', 'eb3421d2-fd3c-4323-ae07-5cd94ce8aff7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:28 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:51:28 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:28 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.276s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:51:28 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Deleted volume successfully. Sep 01 12:51:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e09da025-0b51-4c93-8f34-67e8a5da299b tempest-VolumeDependencyTests-535722434 None] Lock "cinder-62511c9b-a6d9-4177-84e1-4224572b90d0-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:51:38 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=56,cinder:SELECT=48,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:51:38 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=43,cinder:INSERT=18,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Flow 'volume_create_manager' (d10cb8c9-877f-48ce-877e-3b36d7ec7c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e80c61a-fff4-4018-ac3e-79a48127c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e80c61a-fff4-4018-ac3e-79a48127c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231437564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62a6705-d5e2-47fa-8539-b11aa7d73f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115e1ac50bf248ba9acc229e2e5fa310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:49Z,use_quota=True,user_id='e91c7be602c34575b9de1ea8e386f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5756f3fb-e9d5-407e-8fd7-152a9a753ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5756f3fb-e9d5-407e-8fd7-152a9a753ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b1a56d-c7f5-4348-904e-fc6d1dcc2856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b1a56d-c7f5-4348-904e-fc6d1dcc2856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62a6705-d5e2-47fa-8539-b11aa7d73f07', 'volume_name': 'volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9625b643-46f5-4fd8-9961-aae75ac021c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9625b643-46f5-4fd8-9961-aae75ac021c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2d72e1-a8bb-4647-ab76-9b134ec2e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Volume f62a6705-d5e2-47fa-8539-b11aa7d73f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07', 'volume_size': 1} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231437564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62a6705-d5e2-47fa-8539-b11aa7d73f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115e1ac50bf248ba9acc229e2e5fa310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:51:49Z,use_quota=True,user_id='e91c7be602c34575b9de1ea8e386f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Creating volume f62a6705-d5e2-47fa-8539-b11aa7d73f07 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:51:49 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:49 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 1073741824 Sep 01 12:51:49 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:49 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 1073741824" returned: 0 in 0.476s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:51:49 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 Sep 01 12:51:49 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:51:49 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2d72e1-a8bb-4647-ab76-9b134ec2e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47903f10-eb44-4e86-950c-2215448aed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:51:49 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Volume volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 (f62a6705-d5e2-47fa-8539-b11aa7d73f07): created successfully Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47903f10-eb44-4e86-950c-2215448aed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:51:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Flow 'volume_create_manager' (d10cb8c9-877f-48ce-877e-3b36d7ec7c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:51:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e0f35fb7-9bd9-48dd-9740-56a144560c60 tempest-TestMinimumBasicScenario-1203551287 None] Created volume successfully. Sep 01 12:51:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fd318040-60c4-44e0-aa24-d62eabcce32c req-a09e5789-8e68-4374-9616-cc1e087c577a tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:51:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fd318040-60c4-44e0-aa24-d62eabcce32c req-a09e5789-8e68-4374-9616-cc1e087c577a tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:51:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-fd318040-60c4-44e0-aa24-d62eabcce32c req-a09e5789-8e68-4374-9616-cc1e087c577a tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:51:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-fd318040-60c4-44e0-aa24-d62eabcce32c req-a09e5789-8e68-4374-9616-cc1e087c577a tempest-TestMinimumBasicScenario-1203551287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f1f0ad7-426d-4cd9-9b22-17ad7ae6611c', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:51:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-fd318040-60c4-44e0-aa24-d62eabcce32c req-a09e5789-8e68-4374-9616-cc1e087c577a tempest-TestMinimumBasicScenario-1203551287 None] attachment_update completed successfully. Sep 01 12:52:11 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:52:11 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:52:26 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:52:26 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:52:26 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:52:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:52:35 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-9d248c01-5aae-40aa-845e-8a32a7582a30 req-d531852d-7765-4787-b82f-1da80598d876 tempest-TestMinimumBasicScenario-1203551287 None] Terminate volume connection completed successfully. Sep 01 12:52:35 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-9d248c01-5aae-40aa-845e-8a32a7582a30 req-d531852d-7765-4787-b82f-1da80598d876 tempest-TestMinimumBasicScenario-1203551287 None] Deleting attachment 5f1f0ad7-426d-4cd9-9b22-17ad7ae6611c. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "cinder-f62a6705-d5e2-47fa-8539-b11aa7d73f07-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "cinder-f62a6705-d5e2-47fa-8539-b11aa7d73f07-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "cinder-quobyte-f62a6705-d5e2-47fa-8539-b11aa7d73f07" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "cinder-quobyte-f62a6705-d5e2-47fa-8539-b11aa7d73f07" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[716e0b92-7304-4544-806e-f76487eaf3ed]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:52:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:52:36 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 Sep 01 12:52:36 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:52:37 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:52:37 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07 Sep 01 12:52:37 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:52:37 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f62a6705-d5e2-47fa-8539-b11aa7d73f07" returned: 0 in 0.241s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "cinder-quobyte-f62a6705-d5e2-47fa-8539-b11aa7d73f07" released by "delete_volume" :: held 0.646s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Created reservations ['69bb5ed1-014f-4e24-8b77-be867dc8edc6', 'db88d52d-bd18-4c59-aa4d-f967f4a4397a', '0b00adc6-da6b-481c-86a9-70908482a0b9', '2fa3d3b6-ea85-4793-8cf0-aa6348956017'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:52:37 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:52:37 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:52:37 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.245s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:52:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Deleted volume successfully. Sep 01 12:52:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8f41b936-ffeb-473f-b1a1-b782817146b6 tempest-TestMinimumBasicScenario-1203551287 None] Lock "cinder-f62a6705-d5e2-47fa-8539-b11aa7d73f07-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:52:47 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:52:47 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Flow 'volume_create_manager' (ba59039d-f891-424a-84c6-aa2520518e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ae7f1-27bc-4ea3-9305-e04f666faceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ae7f1-27bc-4ea3-9305-e04f666faceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1558104849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043ce115-55ac-4449-af2a-e8556d76bec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39094868f874c06a7db02390f31f79d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:53:15Z,use_quota=True,user_id='bf14ee7569f74ecd9b4c4491c2f58587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d38263-f200-452c-b4f8-d3b82759359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d38263-f200-452c-b4f8-d3b82759359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ce1a07-8285-46f5-b43a-f976e06df130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ce1a07-8285-46f5-b43a-f976e06df130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043ce115-55ac-4449-af2a-e8556d76bec4', 'volume_name': 'volume-043ce115-55ac-4449-af2a-e8556d76bec4', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef400e2-9458-4f73-9b76-13c433beba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef400e2-9458-4f73-9b76-13c433beba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597b70b1-236a-44b6-abc4-5bb528eecb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:14 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Volume 043ce115-55ac-4449-af2a-e8556d76bec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043ce115-55ac-4449-af2a-e8556d76bec4', 'volume_size': 1} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1558104849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043ce115-55ac-4449-af2a-e8556d76bec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39094868f874c06a7db02390f31f79d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:53:15Z,use_quota=True,user_id='bf14ee7569f74ecd9b4c4491c2f58587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Creating volume 043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:53:14 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:53:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:14 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 1073741824 Sep 01 12:53:14 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:15 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 1073741824" returned: 0 in 0.438s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:15 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:53:15 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:15 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597b70b1-236a-44b6-abc4-5bb528eecb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043ce115-55ac-4449-af2a-e8556d76bec4', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb90e0b-2bf8-4d89-88f1-682114eef86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:15 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Volume volume-043ce115-55ac-4449-af2a-e8556d76bec4 (043ce115-55ac-4449-af2a-e8556d76bec4): created successfully Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb90e0b-2bf8-4d89-88f1-682114eef86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:15 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Flow 'volume_create_manager' (ba59039d-f891-424a-84c6-aa2520518e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:53:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-42bf99aa-0856-4625-a168-307fe9b5c13e tempest-TestStampPattern-342558807 None] Created volume successfully. Sep 01 12:53:25 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:53:25 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:26 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:53:26 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:26 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:53:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:53:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-daa95f94-c947-47a8-a44b-34a317e9a64d req-1614cfd3-0605-4220-8a14-b77a1f3d2040 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-daa95f94-c947-47a8-a44b-34a317e9a64d req-1614cfd3-0605-4220-8a14-b77a1f3d2040 tempest-TestStampPattern-342558807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-daa95f94-c947-47a8-a44b-34a317e9a64d req-1614cfd3-0605-4220-8a14-b77a1f3d2040 tempest-TestStampPattern-342558807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:45 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-daa95f94-c947-47a8-a44b-34a317e9a64d req-1614cfd3-0605-4220-8a14-b77a1f3d2040 tempest-TestStampPattern-342558807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-043ce115-55ac-4449-af2a-e8556d76bec4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c23f18dd-7af2-411c-ac0f-3f976b0f08a0', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:53:45 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-daa95f94-c947-47a8-a44b-34a317e9a64d req-1614cfd3-0605-4220-8a14-b77a1f3d2040 tempest-TestStampPattern-342558807 None] attachment_update completed successfully. Sep 01 12:53:49 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-0ce7d709-9c54-4826-ad96-33c139ca831b req-6436006b-788b-4f53-bb41-a4d60e618afc tempest-TestStampPattern-342558807 None] Terminate volume connection completed successfully. Sep 01 12:53:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-0ce7d709-9c54-4826-ad96-33c139ca831b req-6436006b-788b-4f53-bb41-a4d60e618afc tempest-TestStampPattern-342558807 None] Deleting attachment c23f18dd-7af2-411c-ac0f-3f976b0f08a0. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Creating offline snapshot 313aa9e2-aebe-474a-a19b-756b12f91b7d of volume 043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc336e-1f58-44d5-b4ba-5541159ab1db]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:50 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:53:50 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:50 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.346s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:50 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d 1G Sep 01 12:53:50 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:50 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d 1G" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043ce115-55ac-4449-af2a-e8556d76bec4 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:50 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043ce115-55ac-4449-af2a-e8556d76bec4 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:53:50 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:51 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-043ce115-55ac-4449-af2a-e8556d76bec4 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:51 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d is being set with open permissions: ugo+rw Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:51 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:53:51 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:51 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.241s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:51 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info Sep 01 12:53:51 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:51 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info" returned: 0 in 0.243s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:51 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info is being set with open permissions: ugo+rw Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:51 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info Sep 01 12:53:51 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:51 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.info" returned: 0 in 0.242s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7d46f705-40a1-4fff-bc67-810e2e3c44d9 tempest-TestStampPattern-342558807 None] Create snapshot completed successfully Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Flow 'volume_create_manager' (da7d1172-bf6a-432e-9c27-e5a2b01e7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2120afd-0597-41fc-8a6d-c3499641f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2120afd-0597-41fc-8a6d-c3499641f599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1479487647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c76bd4a-3804-4cb1-812f-e7a38b3d5853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39094868f874c06a7db02390f31f79d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=313aa9e2-aebe-474a-a19b-756b12f91b7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:53:59Z,use_quota=True,user_id='bf14ee7569f74ecd9b4c4491c2f58587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0830a766-58f1-42be-8a78-54e5034c99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0830a766-58f1-42be-8a78-54e5034c99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc95b5-d5a8-4461-8089-ad205e3e5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fcc95b5-d5a8-4461-8089-ad205e3e5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c76bd4a-3804-4cb1-812f-e7a38b3d5853', 'volume_name': 'volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853', 'volume_size': 1, 'snapshot_id': '313aa9e2-aebe-474a-a19b-756b12f91b7d'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f215d60-e38b-49d0-8aed-67e8b2910c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f215d60-e38b-49d0-8aed-67e8b2910c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a21522c-8dd9-4969-953c-a77ec8980044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:53:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Volume 1c76bd4a-3804-4cb1-812f-e7a38b3d5853: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853', 'volume_size': 1, 'snapshot_id': '313aa9e2-aebe-474a-a19b-756b12f91b7d'} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Creating volume 1c76bd4a-3804-4cb1-812f-e7a38b3d5853 from snapshot 313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] snapshot: 313aa9e2-aebe-474a-a19b-756b12f91b7d, volume: 1c76bd4a-3804-4cb1-812f-e7a38b3d5853, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[deceff5a-cfb2-4133-8dd8-5ff6e523ca6d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:53:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:59 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:53:59 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:59 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.380s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043ce115-55ac-4449-af2a-e8556d76bec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921ccef-681b-4ee1-9235-101419ff127e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:59 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:53:59 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:53:59 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.398s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:53:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:53:59 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 Sep 01 12:53:59 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:05 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" returned: 0 in 6.025s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:05 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:54:05 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Converted 1024.00 MB image at 169.93 MB/s Sep 01 12:54:05 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 is being set with open permissions: ugo+rw Sep 01 12:54:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:05 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 Sep 01 12:54:05 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:06 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" returned: 0 in 0.288s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" released by "_copy_volume_from_snapshot" :: held 7.174s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" released by "_create_volume_from_snapshot" :: held 7.247s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.267s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a21522c-8dd9-4969-953c-a77ec8980044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853', 'volume_size': 1, 'snapshot_id': '313aa9e2-aebe-474a-a19b-756b12f91b7d'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba85323-9b11-4d35-8c01-d9fe30136e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:54:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Volume volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 (1c76bd4a-3804-4cb1-812f-e7a38b3d5853): created successfully Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba85323-9b11-4d35-8c01-d9fe30136e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:54:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Flow 'volume_create_manager' (da7d1172-bf6a-432e-9c27-e5a2b01e7403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:54:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4a7e135b-ec1e-4f8d-9397-1d1cd5ed11f7 tempest-TestStampPattern-342558807 None] Created volume successfully. Sep 01 12:54:16 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:54:16 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:26 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:54:26 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:26 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.254s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:54:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:54:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2dab4de5-828e-404d-b5e0-0e0239b71565 req-8123f31e-c47f-46eb-9274-4ad07da007c5 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:54:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2dab4de5-828e-404d-b5e0-0e0239b71565 req-8123f31e-c47f-46eb-9274-4ad07da007c5 tempest-TestStampPattern-342558807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:54:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [req-2dab4de5-828e-404d-b5e0-0e0239b71565 req-8123f31e-c47f-46eb-9274-4ad07da007c5 tempest-TestStampPattern-342558807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:54:49 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-2dab4de5-828e-404d-b5e0-0e0239b71565 req-8123f31e-c47f-46eb-9274-4ad07da007c5 tempest-TestStampPattern-342558807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3', 'name': 'volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d920773-113f-4fbf-99ce-c9cd5b80d8d4', 'enforce_multipath': True} {{(pid=87008) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 12:54:49 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-2dab4de5-828e-404d-b5e0-0e0239b71565 req-8123f31e-c47f-46eb-9274-4ad07da007c5 tempest-TestStampPattern-342558807 None] attachment_update completed successfully. Sep 01 12:54:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [req-c6927e5a-c753-4bf5-bf9a-74c01764f537 req-6f42ea2b-1118-4374-a717-3b258d668b4d tempest-TestStampPattern-342558807 None] Terminate volume connection completed successfully. Sep 01 12:54:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [req-c6927e5a-c753-4bf5-bf9a-74c01764f537 req-6f42ea2b-1118-4374-a717-3b258d668b4d tempest-TestStampPattern-342558807 None] Deleting attachment 3d920773-113f-4fbf-99ce-c9cd5b80d8d4. {{(pid=87008) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 12:54:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-1c76bd4a-3804-4cb1-812f-e7a38b3d5853-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "cinder-1c76bd4a-3804-4cb1-812f-e7a38b3d5853-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2c3d6-907c-4fd7-8f88-bbab509b3ad8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:56 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 Sep 01 12:54:56 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:56 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" returned: 0 in 0.380s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:56 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853 Sep 01 12:54:56 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:56 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" returned: 0 in 0.248s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-1c76bd4a-3804-4cb1-812f-e7a38b3d5853" released by "delete_volume" :: held 0.668s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Created reservations ['802e9dcc-a78e-48b3-a8f8-bc1254db0e20', 'bf93440f-ea46-4973-b9b4-a11f1c13c159', '44617f35-b177-4ac2-b7df-081ab8849f6f', '6a458c0a-4770-456b-b1a2-efec1a69cc99'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:54:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:56 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:54:56 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:57 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:54:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Deleted volume successfully. Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ee758809-5a1e-4f4c-bf88-0e4020625558 tempest-TestStampPattern-342558807 None] Lock "cinder-1c76bd4a-3804-4cb1-812f-e7a38b3d5853-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-313aa9e2-aebe-474a-a19b-756b12f91b7d-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-313aa9e2-aebe-474a-a19b-756b12f91b7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Deleting offline snapshot 313aa9e2-aebe-474a-a19b-756b12f91b7d of volume 043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] snapshot_file for this snap is: volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeba746-4eab-40a1-8f53-fa16fe3e1ad6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:57 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:54:57 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:57 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.370s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-043ce115-55ac-4449-af2a-e8556d76bec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f889612b-6f8c-4699-9808-28ff873caa45]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:54:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:58 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:54:58 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:58 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.524s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:58 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:54:58 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:58 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.326s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:54:58 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d Sep 01 12:54:58 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:54:59 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 01 12:54:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4.313aa9e2-aebe-474a-a19b-756b12f91b7d" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:54:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-313aa9e2-aebe-474a-a19b-756b12f91b7d" released by "_delete_snapshot" :: held 1.576s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" released by "delete_snapshot" :: held 1.600s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:54:59 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Created reservations ['bd7a9118-7699-4667-8928-c56dc55de039', 'cdf1ee87-88c0-4b37-8864-99753af22ee9', 'cede9118-50b9-4cbc-bd2b-8d38a64d71ad', 'a2c1d636-358d-4e3a-bd22-97aaed3961b0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:54:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Delete snapshot completed successfully. Sep 01 12:54:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a51fe127-c70b-4bbb-a4d3-4874ac97aa4a tempest-TestStampPattern-342558807 None] Lock "cinder-313aa9e2-aebe-474a-a19b-756b12f91b7d-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-043ce115-55ac-4449-af2a-e8556d76bec4-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "cinder-043ce115-55ac-4449-af2a-e8556d76bec4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Acquiring lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4503ad-722d-4e95-b25d-922e50bd5f21]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:03 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:55:03 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:03 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.369s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:03 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4 Sep 01 12:55:03 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:04 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-043ce115-55ac-4449-af2a-e8556d76bec4" returned: 0 in 0.261s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "cinder-quobyte-043ce115-55ac-4449-af2a-e8556d76bec4" released by "delete_volume" :: held 0.689s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Created reservations ['6c8406d4-4929-415a-a741-5e1a665ef34c', '0f94a5bd-0c89-4f45-bbae-d86b2c2a9fee', 'd78c0eda-66b8-4f1a-bee1-373c6d206ee5', '68427836-7be7-416d-97b2-a2faff975479'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:04 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:04 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:04 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Deleted volume successfully. Sep 01 12:55:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0a144780-cb69-4e2d-8fd1-52f41a21bf4e tempest-TestStampPattern-342558807 None] Lock "cinder-043ce115-55ac-4449-af2a-e8556d76bec4-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:55:14 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Flow 'volume_create_manager' (4acbb1f6-3fa7-4bb4-8f78-de31558c95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda68efd-a54c-49ba-9696-ea7c92924fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda68efd-a54c-49ba-9696-ea7c92924fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eacdfd1-cc7f-43ec-b317-26bd56ba3174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebb2aecc90b42448acda7d7e828260a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:19Z,use_quota=True,user_id='07b1f85942af4fbea987606470850bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4acf46-d792-415c-85c8-ca565a498201),volume_type_id=1c4acf46-d792-415c-85c8-ca565a498201)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b466bc5-ee93-4af6-b87d-6306a5cf6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b466bc5-ee93-4af6-b87d-6306a5cf6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa66cb8-b69e-4547-bf4e-9732ba227d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa66cb8-b69e-4547-bf4e-9732ba227d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5eacdfd1-cc7f-43ec-b317-26bd56ba3174', 'volume_name': 'volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174', 'volume_size': 1, 'image_id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff3bcd9734eada3b60e375740d281797', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ebb2aecc90b42448acda7d7e828260a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1e1bcaea6e7766168bc3a00c979933f55e138b45b97953bbd0147c71825b4f076851da7d0012c37eb209aea3c60fbed44d514f5213633dcb7f28f7d714d0106', 'id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39ef6290-933c-4558-bb5d-167a56be21a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46893ac-56b0-406d-b8c2-8505472db58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46893ac-56b0-406d-b8c2-8505472db58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d7cd6b-ee07-4a69-b382-acd12f836bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:19 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174', 'volume_size': 1, 'image_id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff3bcd9734eada3b60e375740d281797', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ebb2aecc90b42448acda7d7e828260a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1e1bcaea6e7766168bc3a00c979933f55e138b45b97953bbd0147c71825b4f076851da7d0012c37eb209aea3c60fbed44d514f5213633dcb7f28f7d714d0106', 'id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39ef6290-933c-4558-bb5d-167a56be21a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Trying to clone 5eacdfd1-cc7f-43ec-b317-26bd56ba3174 from image 39ef6290-933c-4558-bb5d-167a56be21a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:55:19 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc904259-0c16-47cf-9c1a-4c80577bd126]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:19 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:19 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:20 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:20 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:20 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:20 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Temporary image 39ef6290-933c-4558-bb5d-167a56be21a5 is fetched for user 07b1f85942af4fbea987606470850bbc. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb3419-7c07-4c33-8198-98f979913610]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:20 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:20 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:20 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:21 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:21 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:21 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eacdfd1-cc7f-43ec-b317-26bd56ba3174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ebb2aecc90b42448acda7d7e828260a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:19Z,use_quota=True,user_id='07b1f85942af4fbea987606470850bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c4acf46-d792-415c-85c8-ca565a498201),volume_type_id=1c4acf46-d792-415c-85c8-ca565a498201)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Creating volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:21 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:21 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1073741824 Sep 01 12:55:21 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:21 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1073741824" returned: 0 in 0.409s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:21 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 Sep 01 12:55:21 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:21 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" returned: 0 in 0.243s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Attempting download of 39ef6290-933c-4558-bb5d-167a56be21a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}])) to volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:55:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36532b0-1e2c-4d6e-ad77-d5a1c0392465]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:22 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij Sep 01 12:55:22 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:22 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij" returned: 0 in 0.330s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:22 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij Sep 01 12:55:22 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:22 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij" returned: 1 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39ef6290-933c-4558-bb5d-167a56be21a5_7k990rij' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ce8dc-f996-4c66-9efe-97b73d2154e0]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:22 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:22 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:23 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:23 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD Sep 01 12:55:23 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:23 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] 39ef6290-933c-4558-bb5d-167a56be21a5 was raw, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:23 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 Sep 01 12:55:23 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:23 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" returned: 0 in 0.483s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39ef6290-933c-4558-bb5d-167a56be21a5__qsxkxjedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:55:23 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:55:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:23 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1G Sep 01 12:55:23 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:24 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 1G" returned: 0 in 0.343s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Downloaded image 39ef6290-933c-4558-bb5d-167a56be21a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}])) to volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Temporary image 39ef6290-933c-4558-bb5d-167a56be21a5 for user 07b1f85942af4fbea987606470850bbc is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Marking volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Copying metadata from image 39ef6290-933c-4558-bb5d-167a56be21a5 to 5eacdfd1-cc7f-43ec-b317-26bd56ba3174. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Creating volume glance metadata for volume 5eacdfd1-cc7f-43ec-b317-26bd56ba3174 backed by image 39ef6290-933c-4558-bb5d-167a56be21a5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff3bcd9734eada3b60e375740d281797', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d7cd6b-ee07-4a69-b382-acd12f836bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174', 'volume_size': 1, 'image_id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39ef6290-933c-4558-bb5d-167a56be21a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff3bcd9734eada3b60e375740d281797', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ebb2aecc90b42448acda7d7e828260a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1e1bcaea6e7766168bc3a00c979933f55e138b45b97953bbd0147c71825b4f076851da7d0012c37eb209aea3c60fbed44d514f5213633dcb7f28f7d714d0106', 'id': '39ef6290-933c-4558-bb5d-167a56be21a5', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39ef6290-933c-4558-bb5d-167a56be21a5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc34cda7-607b-4bdc-9c03-3849469f500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Volume volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 (5eacdfd1-cc7f-43ec-b317-26bd56ba3174): created successfully Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc34cda7-607b-4bdc-9c03-3849469f500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Flow 'volume_create_manager' (4acbb1f6-3fa7-4bb4-8f78-de31558c95b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b4cd54b2-a76a-4cdf-9e55-6a23b403478c tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Created volume successfully. Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Acquiring lock "cinder-5eacdfd1-cc7f-43ec-b317-26bd56ba3174-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "cinder-5eacdfd1-cc7f-43ec-b317-26bd56ba3174-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Acquiring lock "cinder-quobyte-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "cinder-quobyte-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7375190-319a-402a-bf29-b406b6dcf663]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:24 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 Sep 01 12:55:24 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:25 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" returned: 0 in 0.373s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:25 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174 Sep 01 12:55:25 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:25 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" returned: 0 in 0.243s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "cinder-quobyte-5eacdfd1-cc7f-43ec-b317-26bd56ba3174" released by "delete_volume" :: held 0.654s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:25 devstack cinder-volume[87008]: WARNING cinder.quota [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:55:25 devstack cinder-volume[87008]: WARNING cinder.quota [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Created reservations ['e96e6d78-7592-4560-85a0-5a76de45fce5', 'd0daf392-400a-4bef-b91a-498d2554f516', '69a5defc-58f7-4ade-8c5d-89abb38362ca', '23ee0651-fa2c-40c9-8bee-cee99a69ac0d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:25 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:25 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:25 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.250s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Deleted volume successfully. Sep 01 12:55:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c683318f-7273-42d9-882a-0aa15c16df4b tempest-VolumeAndVolumeTypeFromImageTest-812228641 None] Lock "cinder-5eacdfd1-cc7f-43ec-b317-26bd56ba3174-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:26 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:26 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:26 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:55:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (495be352-a414-4368-936a-8fe2a7c933d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d66894-571b-4878-8bc9-423f69ec8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d66894-571b-4878-8bc9-423f69ec8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604581341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c448c45b-3b5c-4020-90f6-d76f34be3674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:30Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0743508f-5761-4d0f-9f86-4b388b5caa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0743508f-5761-4d0f-9f86-4b388b5caa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ae9d97-4fc1-42ac-b639-0793df89af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ae9d97-4fc1-42ac-b639-0793df89af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c448c45b-3b5c-4020-90f6-d76f34be3674', 'volume_name': 'volume-c448c45b-3b5c-4020-90f6-d76f34be3674', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e192dc6-7b12-4d67-8ed5-e44b8a6835c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e192dc6-7b12-4d67-8ed5-e44b8a6835c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9249d9b-4493-4d09-9cec-9de6b9f9781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Volume c448c45b-3b5c-4020-90f6-d76f34be3674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c448c45b-3b5c-4020-90f6-d76f34be3674', 'volume_size': 1} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604581341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c448c45b-3b5c-4020-90f6-d76f34be3674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:30Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Creating volume c448c45b-3b5c-4020-90f6-d76f34be3674 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:30 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:30 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 1073741824 Sep 01 12:55:30 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (95e19d89-3932-40cc-a682-30c1bca5aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db36fc57-9afb-46fb-9a72-bf2d4d8092f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db36fc57-9afb-46fb-9a72-bf2d4d8092f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-358592688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455de1c-a5c3-4fdc-8229-33756f25cc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:30Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae9447-07d1-4334-ae70-867877082574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ae9447-07d1-4334-ae70-867877082574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c614fb-5b77-47f8-b762-c6d0e027f023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c614fb-5b77-47f8-b762-c6d0e027f023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c455de1c-a5c3-4fdc-8229-33756f25cc72', 'volume_name': 'volume-c455de1c-a5c3-4fdc-8229-33756f25cc72', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e61c04-7932-4893-97ac-b6e28e002e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e61c04-7932-4893-97ac-b6e28e002e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7c2e50-ba92-4ccc-b10f-5eeec0ea41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Volume c455de1c-a5c3-4fdc-8229-33756f25cc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c455de1c-a5c3-4fdc-8229-33756f25cc72', 'volume_size': 1} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:30 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 1073741824" returned: 0 in 0.564s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:30 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 Sep 01 12:55:30 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (4f15fcb0-713c-4838-9bb4-abda605c410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1248261d-1eef-48d5-91dd-b7a24dc01889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1248261d-1eef-48d5-91dd-b7a24dc01889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531663982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5edc3ba-c758-4dc2-ac88-3bc8e933d75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:31Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b194ad55-c3fa-425c-8844-f7722cc6d801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b194ad55-c3fa-425c-8844-f7722cc6d801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c298df-a93e-4c3c-a63e-d652d3356822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c298df-a93e-4c3c-a63e-d652d3356822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5edc3ba-c758-4dc2-ac88-3bc8e933d75b', 'volume_name': 'volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4105b19-e7b8-465b-9bdd-aad1d3c184ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4105b19-e7b8-465b-9bdd-aad1d3c184ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0965e1b-b770-4274-aab3-d4006e5b0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Volume f5edc3ba-c758-4dc2-ac88-3bc8e933d75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b', 'volume_size': 1} Sep 01 12:55:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:31 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-358592688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455de1c-a5c3-4fdc-8229-33756f25cc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:30Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Creating volume c455de1c-a5c3-4fdc-8229-33756f25cc72 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9249d9b-4493-4d09-9cec-9de6b9f9781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c448c45b-3b5c-4020-90f6-d76f34be3674', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 1073741824 Sep 01 12:55:31 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed9a1e8-0ab9-45cf-889d-6fbfd11f8e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Volume volume-c448c45b-3b5c-4020-90f6-d76f34be3674 (c448c45b-3b5c-4020-90f6-d76f34be3674): created successfully Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed9a1e8-0ab9-45cf-889d-6fbfd11f8e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (495be352-a414-4368-936a-8fe2a7c933d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fd1690b0-9a20-45c1-91e9-dcdeee54d295 tempest-CreateVolumesFromImageTest-650972223 None] Created volume successfully. Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (bc8d1a8d-b13a-4d94-8dee-1e0aed0f187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cc943a-e024-42f3-be0c-3cabdbf0a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cc943a-e024-42f3-be0c-3cabdbf0a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020927034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc01d9d-54f2-4e40-9944-2e0af4cdf150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:31Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308b6ff1-835f-437b-a76f-c5b610646eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308b6ff1-835f-437b-a76f-c5b610646eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76198861-e2da-4743-8e4a-19bcd56be68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76198861-e2da-4743-8e4a-19bcd56be68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc01d9d-54f2-4e40-9944-2e0af4cdf150', 'volume_name': 'volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a6ade2-88d8-435c-a267-8492a5d6c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a6ade2-88d8-435c-a267-8492a5d6c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207f0fb7-bb6b-4f89-8469-94ce8f256544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Volume 8cc01d9d-54f2-4e40-9944-2e0af4cdf150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150', 'volume_size': 1} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:31 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 1073741824" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:31 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 Sep 01 12:55:31 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (7931ec4b-8a26-4f84-bcff-44c9b5ac71f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f074f916-8cbc-4c28-8090-bfb99779d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f074f916-8cbc-4c28-8090-bfb99779d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509239965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504ebceb-6bd2-4296-b79b-0c52f880049d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:32Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c014e9-dead-4a50-9c33-0a43d68d4c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c014e9-dead-4a50-9c33-0a43d68d4c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5aff8-9e0f-4079-bc3e-73990af0bd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b5aff8-9e0f-4079-bc3e-73990af0bd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504ebceb-6bd2-4296-b79b-0c52f880049d', 'volume_name': 'volume-504ebceb-6bd2-4296-b79b-0c52f880049d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f81b4ca-6c26-41f4-ae17-8dee818afe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f81b4ca-6c26-41f4-ae17-8dee818afe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8740e9-bc54-4879-a1d6-9d8c4a4d84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Volume 504ebceb-6bd2-4296-b79b-0c52f880049d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504ebceb-6bd2-4296-b79b-0c52f880049d', 'volume_size': 1} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:31 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-531663982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5edc3ba-c758-4dc2-ac88-3bc8e933d75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:31Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Creating volume f5edc3ba-c758-4dc2-ac88-3bc8e933d75b {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7c2e50-ba92-4ccc-b10f-5eeec0ea41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c455de1c-a5c3-4fdc-8229-33756f25cc72', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bb44fe-4af1-4fb9-9190-c5a159d4708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:31 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b 1073741824 Sep 01 12:55:31 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Volume volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 (c455de1c-a5c3-4fdc-8229-33756f25cc72): created successfully Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bb44fe-4af1-4fb9-9190-c5a159d4708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (95e19d89-3932-40cc-a682-30c1bca5aec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d4b4e08-3cab-4c35-a56d-97ba11d997c7 tempest-CreateVolumesFromImageTest-650972223 None] Created volume successfully. Sep 01 12:55:32 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b 1073741824" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:32 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b Sep 01 12:55:32 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:32 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" returned: 0 in 0.243s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020927034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc01d9d-54f2-4e40-9944-2e0af4cdf150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:31Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Creating volume 8cc01d9d-54f2-4e40-9944-2e0af4cdf150 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:32 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0965e1b-b770-4274-aab3-d4006e5b0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80b24cb-0cfc-4112-9177-7c47f77fb270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:32 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 1073741824 Sep 01 12:55:32 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:32 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Volume volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b (f5edc3ba-c758-4dc2-ac88-3bc8e933d75b): created successfully Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80b24cb-0cfc-4112-9177-7c47f77fb270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (4f15fcb0-713c-4838-9bb4-abda605c410f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:32 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-eab2991c-177b-4843-a0f4-33ebc01b9e0b tempest-CreateVolumesFromImageTest-650972223 None] Created volume successfully. Sep 01 12:55:32 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:32 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 1073741824" returned: 0 in 0.440s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:33 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 Sep 01 12:55:33 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:33 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509239965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504ebceb-6bd2-4296-b79b-0c52f880049d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2341d7fc091545a683f81baa3a4a9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:32Z,use_quota=True,user_id='7a4e087e5aa34746a900af6ef722778a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Creating volume 504ebceb-6bd2-4296-b79b-0c52f880049d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:33 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207f0fb7-bb6b-4f89-8469-94ce8f256544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:33 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d 1073741824 Sep 01 12:55:33 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a137b-4ff0-4dc3-b515-8e6ceeeccee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:33 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Volume volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 (8cc01d9d-54f2-4e40-9944-2e0af4cdf150): created successfully Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a137b-4ff0-4dc3-b515-8e6ceeeccee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (bc8d1a8d-b13a-4d94-8dee-1e0aed0f187f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:33 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-21ae3d98-28f1-4a57-afc7-74b81461350e tempest-CreateVolumesFromImageTest-650972223 None] Created volume successfully. Sep 01 12:55:33 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d 1073741824" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:33 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d Sep 01 12:55:33 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:33 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8740e9-bc54-4879-a1d6-9d8c4a4d84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504ebceb-6bd2-4296-b79b-0c52f880049d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd801a9-15ce-471e-9b2f-eb82c2e11fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:34 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Volume volume-504ebceb-6bd2-4296-b79b-0c52f880049d (504ebceb-6bd2-4296-b79b-0c52f880049d): created successfully Sep 01 12:55:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd801a9-15ce-471e-9b2f-eb82c2e11fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:34 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Flow 'volume_create_manager' (7931ec4b-8a26-4f84-bcff-44c9b5ac71f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:34 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0e087683-ec4d-4f0f-9c69-dbd2a5040e1f tempest-CreateVolumesFromImageTest-650972223 None] Created volume successfully. Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-504ebceb-6bd2-4296-b79b-0c52f880049d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-504ebceb-6bd2-4296-b79b-0c52f880049d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-quobyte-504ebceb-6bd2-4296-b79b-0c52f880049d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-504ebceb-6bd2-4296-b79b-0c52f880049d" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[75019c34-d041-4a60-a673-a9e667f691bb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:35 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d Sep 01 12:55:35 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:35 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:35 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d Sep 01 12:55:35 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:35 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-504ebceb-6bd2-4296-b79b-0c52f880049d" returned: 0 in 0.247s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-504ebceb-6bd2-4296-b79b-0c52f880049d" released by "delete_volume" :: held 0.645s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Created reservations ['0f10424c-c207-4dee-901c-c9b012bcdca0', 'ccdde392-6721-4613-8448-0dbae3dc694e', '3f18ccaf-234d-4673-a20a-27a361e32005', '981accc8-1f91-4286-a6c0-8e913bf64b57'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:35 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:35 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:36 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.255s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Deleted volume successfully. Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d6a324cb-fffa-4bed-9a82-dd08a4c71217 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-504ebceb-6bd2-4296-b79b-0c52f880049d-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-8cc01d9d-54f2-4e40-9944-2e0af4cdf150-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-8cc01d9d-54f2-4e40-9944-2e0af4cdf150-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-quobyte-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c7deed-95b7-4971-8928-89ac246eab31]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:36 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 Sep 01 12:55:36 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:36 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" returned: 0 in 0.371s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:36 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150 Sep 01 12:55:36 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:36 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" returned: 0 in 0.255s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-8cc01d9d-54f2-4e40-9944-2e0af4cdf150" released by "delete_volume" :: held 0.664s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:36 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Created reservations ['51860fb2-0dbc-4a7d-8ccf-005065f28ed1', 'b17499b6-76dd-456b-a9ac-21fa74569548', '40d5813a-d542-4345-b653-011825172ae0', '0305639b-b888-4779-83fc-d92af7f4d1ea'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:37 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:37 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:37 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:37 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Deleted volume successfully. Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-689d461d-6c6c-4e58-9053-0c1e39cb6841 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-8cc01d9d-54f2-4e40-9944-2e0af4cdf150-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-quobyte-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6103199-8c3b-46cc-ad08-c578f55a12e3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:37 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b Sep 01 12:55:37 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:38 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" returned: 0 in 0.356s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:38 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b Sep 01 12:55:38 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:38 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b" released by "delete_volume" :: held 0.655s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Created reservations ['d60984d6-f43f-4105-a493-cb7f19538af8', '57377734-8fd9-42e1-94ed-2b6b25ff7c9e', '34ae3092-b7c1-4227-b538-9dbc6c1e721c', '89a75d9c-b84f-4359-93f4-fd1d75180955'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:38 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:38 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:38 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Deleted volume successfully. Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-0b04e4a9-b183-4e0a-a60b-6cd8ad5ae806 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-f5edc3ba-c758-4dc2-ac88-3bc8e933d75b-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-c455de1c-a5c3-4fdc-8229-33756f25cc72-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-c455de1c-a5c3-4fdc-8229-33756f25cc72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-quobyte-c455de1c-a5c3-4fdc-8229-33756f25cc72" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-c455de1c-a5c3-4fdc-8229-33756f25cc72" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfdd58-a9ef-4250-a1a3-70d987599b75]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:39 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 Sep 01 12:55:39 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:39 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72" returned: 0 in 0.351s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:39 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72 Sep 01 12:55:39 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:39 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c455de1c-a5c3-4fdc-8229-33756f25cc72" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-c455de1c-a5c3-4fdc-8229-33756f25cc72" released by "delete_volume" :: held 0.649s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Created reservations ['80ad9fe5-6bd8-4a15-ada7-f607ce2fe65a', '2729a2c7-539f-4854-ae8a-2b64297fa37d', '407681b3-8c1d-449e-8c37-18b1b6863c2e', 'abca33ac-3602-4692-81ad-6d3c6ccef68f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:39 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:39 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:39 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.252s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Deleted volume successfully. Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e8ed3506-1fd4-42aa-8745-d6c9a1dd0674 tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-c455de1c-a5c3-4fdc-8229-33756f25cc72-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-c448c45b-3b5c-4020-90f6-d76f34be3674-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-c448c45b-3b5c-4020-90f6-d76f34be3674-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "cinder-quobyte-c448c45b-3b5c-4020-90f6-d76f34be3674" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-c448c45b-3b5c-4020-90f6-d76f34be3674" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c807953-4e6d-4bf2-9fa4-84b4a125aca6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:40 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 Sep 01 12:55:40 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:40 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674" returned: 0 in 0.374s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:40 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674 Sep 01 12:55:40 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:40 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c448c45b-3b5c-4020-90f6-d76f34be3674" returned: 0 in 0.245s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-quobyte-c448c45b-3b5c-4020-90f6-d76f34be3674" released by "delete_volume" :: held 0.655s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Created reservations ['63390485-cd50-47b2-ac4d-74c8b896a525', 'c81d4fdd-07cb-4432-aa1b-82597ffe9c00', 'af5026a5-b238-4e88-b58a-46fd2759b4e3', 'a571c7be-8c67-4195-b9b9-49becb6aba96'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:40 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:55:40 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:41 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.316s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:41 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:55:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Deleted volume successfully. Sep 01 12:55:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f1dab7a4-9eb6-4bfa-98dd-9870f6f2385e tempest-CreateVolumesFromImageTest-650972223 None] Lock "cinder-c448c45b-3b5c-4020-90f6-d76f34be3674-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:55:50 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=65,cinder:SELECT=49,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:55:51 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=47,cinder:INSERT=25,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (a1bc3c12-cab8-4e77-85d2-8327be81d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee257485-12ea-4af2-a20b-4ad6e1a7f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee257485-12ea-4af2-a20b-4ad6e1a7f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356014366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231659c2-acaa-4e24-9f8d-7527ac574a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:53Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77726da-7829-416d-88b7-7598ab940180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77726da-7829-416d-88b7-7598ab940180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2160c6a-a984-48e9-b4a7-cde00f94ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2160c6a-a984-48e9-b4a7-cde00f94ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231659c2-acaa-4e24-9f8d-7527ac574a62', 'volume_name': 'volume-231659c2-acaa-4e24-9f8d-7527ac574a62', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865903ca-4d53-40a2-8ad5-a6d25073f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865903ca-4d53-40a2-8ad5-a6d25073f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9d6e9-0357-41db-b023-27a5540272b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume 231659c2-acaa-4e24-9f8d-7527ac574a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231659c2-acaa-4e24-9f8d-7527ac574a62', 'volume_size': 1} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-356014366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231659c2-acaa-4e24-9f8d-7527ac574a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:53Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume 231659c2-acaa-4e24-9f8d-7527ac574a62 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:53 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:53 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 1073741824 Sep 01 12:55:53 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (e54ff639-96fc-40b5-ab9f-1786beacbb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dca68e-7caf-4435-adf4-594d6d5c845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dca68e-7caf-4435-adf4-594d6d5c845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567069975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e27e8-096a-45e5-8554-5fb8ef53a84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:53Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37203261-f103-4e32-91e4-7926f95b59b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37203261-f103-4e32-91e4-7926f95b59b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a602a7ec-9623-46fd-92db-250a8b0be08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a602a7ec-9623-46fd-92db-250a8b0be08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36e27e8-096a-45e5-8554-5fb8ef53a84e', 'volume_name': 'volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0850603c-74a4-443a-a295-ce4ac410437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0850603c-74a4-443a-a295-ce4ac410437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e5e486-1279-491c-9d9a-9159d7a4b3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Volume d36e27e8-096a-45e5-8554-5fb8ef53a84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e', 'volume_size': 1} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (655020d5-d539-46d2-a07a-f63034e2c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499a9f86-6b11-47d9-a211-b0c9c54586ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499a9f86-6b11-47d9-a211-b0c9c54586ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782043727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500da4b1-ec9c-4ecb-82bb-9c84ef5b181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:54Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c627155e-e14c-4e54-8add-647dc0be63c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c627155e-e14c-4e54-8add-647dc0be63c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed1d34d-ea2a-46dc-a1c2-e5ddc4feb487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed1d34d-ea2a-46dc-a1c2-e5ddc4feb487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500da4b1-ec9c-4ecb-82bb-9c84ef5b181d', 'volume_name': 'volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38efc29-6655-4a15-9911-4aa92a614418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38efc29-6655-4a15-9911-4aa92a614418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31d3e82-8e7e-433b-ba44-79de256c48d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume 500da4b1-ec9c-4ecb-82bb-9c84ef5b181d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d', 'volume_size': 1} Sep 01 12:55:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (ea3eaba7-7363-44ed-ac51-7fb3e7971763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e782cd1-0b92-434c-b6d8-69ef736ff027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e782cd1-0b92-434c-b6d8-69ef736ff027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466873445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cd910f-a621-4247-90f8-52a707c449c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:54Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffc4406-c3bf-4d1d-a6cb-e9997160c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffc4406-c3bf-4d1d-a6cb-e9997160c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041fcdb0-c82c-4ac8-bba5-fd8f369c6639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041fcdb0-c82c-4ac8-bba5-fd8f369c6639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cd910f-a621-4247-90f8-52a707c449c5', 'volume_name': 'volume-14cd910f-a621-4247-90f8-52a707c449c5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bd9c60-47ed-42e0-acdb-ae7255b37cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bd9c60-47ed-42e0-acdb-ae7255b37cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39c36ac-889c-4a76-8a60-d4ef91357d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Volume 14cd910f-a621-4247-90f8-52a707c449c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cd910f-a621-4247-90f8-52a707c449c5', 'volume_size': 1} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 1073741824" returned: 0 in 0.744s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:54 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 Sep 01 12:55:54 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:54 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62" returned: 0 in 0.347s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567069975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36e27e8-096a-45e5-8554-5fb8ef53a84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:53Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Creating volume d36e27e8-096a-45e5-8554-5fb8ef53a84e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:54 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:54 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e 1073741824 Sep 01 12:55:54 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd9d6e9-0357-41db-b023-27a5540272b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231659c2-acaa-4e24-9f8d-7527ac574a62', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f68f3a-0a9c-4608-9fb8-2a9b129a3a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-231659c2-acaa-4e24-9f8d-7527ac574a62 (231659c2-acaa-4e24-9f8d-7527ac574a62): created successfully Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f68f3a-0a9c-4608-9fb8-2a9b129a3a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (a1bc3c12-cab8-4e77-85d2-8327be81d0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (076b75d3-c9ca-4f7b-aff2-1be5a1100f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec423a6-37bf-4477-8043-df4ad0bb8a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec423a6-37bf-4477-8043-df4ad0bb8a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860752284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eeabaf-4877-4936-80bb-638550e586c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca30c98-1d3a-40f4-ae59-89d93e7a74b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca30c98-1d3a-40f4-ae59-89d93e7a74b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0e3a66-64f7-467c-aefd-eff5a68d5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0e3a66-64f7-467c-aefd-eff5a68d5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9eeabaf-4877-4936-80bb-638550e586c8', 'volume_name': 'volume-f9eeabaf-4877-4936-80bb-638550e586c8', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0340772-2792-42d0-bb8f-9870a3dc5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0340772-2792-42d0-bb8f-9870a3dc5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fe66a4-73db-4426-ab8d-ecddfd97e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:54 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Volume f9eeabaf-4877-4936-80bb-638550e586c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9eeabaf-4877-4936-80bb-638550e586c8', 'volume_size': 1} Sep 01 12:55:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b401054f-8f7d-4e21-82e5-fb614ddc4a1a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:55 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (a0138146-02da-40e6-97a2-d193b0dfd0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c964300d-cc2d-4d12-a682-f10b643c656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e 1073741824" returned: 0 in 0.682s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c964300d-cc2d-4d12-a682-f10b643c656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923461203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3620eddc-22ad-4678-87ce-351fd9541db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1344063-0996-47bd-9719-d1ff71af7d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1344063-0996-47bd-9719-d1ff71af7d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2411c5-e4d3-4843-9372-dfc6d5f73b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2411c5-e4d3-4843-9372-dfc6d5f73b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3620eddc-22ad-4678-87ce-351fd9541db0', 'volume_name': 'volume-3620eddc-22ad-4678-87ce-351fd9541db0', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036b6420-5ada-423e-af47-ccdb7422563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036b6420-5ada-423e-af47-ccdb7422563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af1721-aa68-4d02-b019-f203cb80f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Volume 3620eddc-22ad-4678-87ce-351fd9541db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3620eddc-22ad-4678-87ce-351fd9541db0', 'volume_size': 1} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:55 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e Sep 01 12:55:55 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (b4adc0f1-95e4-48ce-8b85-9541d7761df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e586b570-f032-4d72-bf83-bef872cc147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e586b570-f032-4d72-bf83-bef872cc147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117503476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19024d6-c0fb-40b8-b0f6-d511063aa0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6488cd7f-0213-4b93-ba5e-f806072bce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6488cd7f-0213-4b93-ba5e-f806072bce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad26a217-cd86-4fdc-9ec9-18e0ae658df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad26a217-cd86-4fdc-9ec9-18e0ae658df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19024d6-c0fb-40b8-b0f6-d511063aa0a2', 'volume_name': 'volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0fc7f4-819b-4e15-8925-dcb85cb302a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0fc7f4-819b-4e15-8925-dcb85cb302a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670e62c3-d2c6-4926-bdf1-1d06953955fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Volume a19024d6-c0fb-40b8-b0f6-d511063aa0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2', 'volume_size': 1} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:55 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e" returned: 0 in 0.310s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782043727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500da4b1-ec9c-4ecb-82bb-9c84ef5b181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:54Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume 500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:55 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e5e486-1279-491c-9d9a-9159d7a4b3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d 1073741824 Sep 01 12:55:55 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2543a1-a30b-4825-a408-3f4026198bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:55 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Volume volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e (d36e27e8-096a-45e5-8554-5fb8ef53a84e): created successfully Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2543a1-a30b-4825-a408-3f4026198bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:55 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (e54ff639-96fc-40b5-ab9f-1786beacbb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c638e0f3-c9b2-4e0e-b4e6-e58bf40670ab tempest-CreateVolumesFromImageTest-145273842 None] Created volume successfully. Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (78a12274-0001-4061-b37f-61b5681ac27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a36a7a-2ad4-40e4-ae84-a3025e708106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a36a7a-2ad4-40e4-ae84-a3025e708106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860296547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d21c4cd-6ee0-4860-8845-fd9172f74991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:56Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc2dd28-cfba-40c1-b24b-518316eec3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc2dd28-cfba-40c1-b24b-518316eec3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182bc612-e1de-4c33-9890-72bcf7c08584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182bc612-e1de-4c33-9890-72bcf7c08584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d21c4cd-6ee0-4860-8845-fd9172f74991', 'volume_name': 'volume-1d21c4cd-6ee0-4860-8845-fd9172f74991', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc868ab-76c1-4e9e-8edd-a1e39671d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc868ab-76c1-4e9e-8edd-a1e39671d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e10e63b-c20d-40a4-a6f1-a8111985ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume 1d21c4cd-6ee0-4860-8845-fd9172f74991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d21c4cd-6ee0-4860-8845-fd9172f74991', 'volume_size': 1} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:56 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d 1073741824" returned: 0 in 0.586s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:56 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d Sep 01 12:55:56 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:56 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466873445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cd910f-a621-4247-90f8-52a707c449c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:54Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Creating volume 14cd910f-a621-4247-90f8-52a707c449c5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:56 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:56 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 1073741824 Sep 01 12:55:56 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31d3e82-8e7e-433b-ba44-79de256c48d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2cc4e2-0985-4f24-99c6-cfdc9454b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (c281b474-747f-459a-890f-52a1c65a43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cebdbbb-6ea3-4da0-894b-aa04243e7fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d (500da4b1-ec9c-4ecb-82bb-9c84ef5b181d): created successfully Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2cc4e2-0985-4f24-99c6-cfdc9454b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (655020d5-d539-46d2-a07a-f63034e2c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cebdbbb-6ea3-4da0-894b-aa04243e7fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644119363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d24931-90e8-4167-a921-a461ca3c5553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:57Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7386b9c4-1be0-4b08-9255-3864b7bc7104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7386b9c4-1be0-4b08-9255-3864b7bc7104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c1713a-bf25-4a61-bedc-39d1865a61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c1713a-bf25-4a61-bedc-39d1865a61bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d24931-90e8-4167-a921-a461ca3c5553', 'volume_name': 'volume-00d24931-90e8-4167-a921-a461ca3c5553', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5012a7e-3419-4286-ae31-c78538e6490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5012a7e-3419-4286-ae31-c78538e6490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee3c50d-5ada-41f6-8f59-5585c91a6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume 00d24931-90e8-4167-a921-a461ca3c5553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d24931-90e8-4167-a921-a461ca3c5553', 'volume_size': 1} Sep 01 12:55:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-98197784-8751-4425-a369-50652ecfa8a5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (ad3bf91d-91ac-47ff-9983-affc015fd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c43e3-b088-4386-a7c6-2d3ca041c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31c43e3-b088-4386-a7c6-2d3ca041c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ffed49-ea6e-42a5-81a3-c7aae58adf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:57Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95435b09-3ede-40f3-a590-4e5c5546e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95435b09-3ede-40f3-a590-4e5c5546e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28faa411-05c5-4892-b556-8e2fce6aecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28faa411-05c5-4892-b556-8e2fce6aecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ffed49-ea6e-42a5-81a3-c7aae58adf2c', 'volume_name': 'volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee9ee3-82c8-4a67-ad02-4eae384bbd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee9ee3-82c8-4a67-ad02-4eae384bbd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f5ec7-8955-4cb3-b0c1-26d0f4243bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume 95ffed49-ea6e-42a5-81a3-c7aae58adf2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c', 'volume_size': 1} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 1073741824" returned: 0 in 0.781s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:57 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 Sep 01 12:55:57 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (81420776-3f9e-4225-b604-42fd2d5dad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce249401-4f0b-4e6a-be1a-4ce2f7f928bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce249401-4f0b-4e6a-be1a-4ce2f7f928bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960281395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b1fd93-99fb-4ec4-8277-3f72e021dcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e6f9dd-e172-4232-a931-4127b756e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e6f9dd-e172-4232-a931-4127b756e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9faebdf-1ad2-46f5-88ca-85e9df648539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9faebdf-1ad2-46f5-88ca-85e9df648539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b1fd93-99fb-4ec4-8277-3f72e021dcfc', 'volume_name': 'volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdbac4f-3b7f-42c0-85a3-05867c587246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdbac4f-3b7f-42c0-85a3-05867c587246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e65b702-c6a6-47f5-808e-c064b09457e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume f5b1fd93-99fb-4ec4-8277-3f72e021dcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc', 'volume_size': 1} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860752284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eeabaf-4877-4936-80bb-638550e586c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Creating volume f9eeabaf-4877-4936-80bb-638550e586c8 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:57 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39c36ac-889c-4a76-8a60-d4ef91357d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cd910f-a621-4247-90f8-52a707c449c5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 1073741824 Sep 01 12:55:57 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8a00f9-c50c-48d2-807b-4311c87d2104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Volume volume-14cd910f-a621-4247-90f8-52a707c449c5 (14cd910f-a621-4247-90f8-52a707c449c5): created successfully Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8a00f9-c50c-48d2-807b-4311c87d2104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (ea3eaba7-7363-44ed-ac51-7fb3e7971763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e4936b8b-7178-4c1c-afdb-c9f7d8ea38b8 tempest-CreateVolumesFromImageTest-145273842 None] Created volume successfully. Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (c9ab396c-5379-46a7-99cf-98b5f657aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a98db8-1053-4836-9c9f-f5ad65f4a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a98db8-1053-4836-9c9f-f5ad65f4a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538540442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6fd133-dc83-4544-90a3-79381b738d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775b1bec-431a-4c93-8d53-9d0429fc08f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775b1bec-431a-4c93-8d53-9d0429fc08f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a242bd6-b4d3-44df-840d-1e4c79202732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a242bd6-b4d3-44df-840d-1e4c79202732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6fd133-dc83-4544-90a3-79381b738d3b', 'volume_name': 'volume-9c6fd133-dc83-4544-90a3-79381b738d3b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197f113d-7b66-44fa-ad90-cc02d40984c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197f113d-7b66-44fa-ad90-cc02d40984c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f610d1-48ac-4288-8ae1-00d002ea35e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume 9c6fd133-dc83-4544-90a3-79381b738d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6fd133-dc83-4544-90a3-79381b738d3b', 'volume_size': 1} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:58 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 1073741824" returned: 0 in 0.582s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:58 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 Sep 01 12:55:58 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Flow 'volume_create_manager' (c8d1f1ab-ad40-4b61-992b-19e81b73376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05ef58c-4f03-4eff-b672-973ff1da8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05ef58c-4f03-4eff-b672-973ff1da8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17ffddc-f092-46aa-8156-404bee290fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a948444e5914132b02adcc529117acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='bbcdaeec70ba4963a77c9305e8ab0139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7529df2a-9ac6-4caa-bf97-795f559202b6),volume_type_id=7529df2a-9ac6-4caa-bf97-795f559202b6)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d181d-c61a-48d0-9779-f72301de7098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3d181d-c61a-48d0-9779-f72301de7098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5bea88-e4fe-4c71-abca-b6dcc935e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:55:58 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.447s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923461203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3620eddc-22ad-4678-87ce-351fd9541db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Creating volume 3620eddc-22ad-4678-87ce-351fd9541db0 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:58 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:58 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 1073741824 Sep 01 12:55:58 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fe66a4-73db-4426-ab8d-ecddfd97e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9eeabaf-4877-4936-80bb-638550e586c8', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aece7324-6432-4e40-8ec7-93b729d673f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Volume volume-f9eeabaf-4877-4936-80bb-638550e586c8 (f9eeabaf-4877-4936-80bb-638550e586c8): created successfully Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aece7324-6432-4e40-8ec7-93b729d673f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (076b75d3-c9ca-4f7b-aff2-1be5a1100f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:58 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-194f852e-a08d-4c7b-9e02-67de2dcde834 tempest-CreateVolumesFromImageTest-145273842 None] Created volume successfully. Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5bea88-e4fe-4c71-abca-b6dcc935e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd17ffddc-f092-46aa-8156-404bee290fe5', 'volume_name': 'volume-d17ffddc-f092-46aa-8156-404bee290fe5', 'volume_size': 1, 'image_id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0b41f5cf8bf35f63b6821086f161f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a948444e5914132b02adcc529117acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1ae31973c6f0ab1c4ba953e01da01399a1bd5eee85cb83b850715162c219db489dd705d0f970989b1a0591ab0a7978fa9cfcb1a44b9a7a1ba27622057b8b6af', 'id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecd6652-981c-40fb-83d4-fb1fafcc89c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecd6652-981c-40fb-83d4-fb1fafcc89c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99294b4-fd47-4774-b50e-f586987a3008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Volume d17ffddc-f092-46aa-8156-404bee290fe5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d17ffddc-f092-46aa-8156-404bee290fe5', 'volume_size': 1, 'image_id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0b41f5cf8bf35f63b6821086f161f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a948444e5914132b02adcc529117acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1ae31973c6f0ab1c4ba953e01da01399a1bd5eee85cb83b850715162c219db489dd705d0f970989b1a0591ab0a7978fa9cfcb1a44b9a7a1ba27622057b8b6af', 'id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 12:55:58 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Trying to clone d17ffddc-f092-46aa-8156-404bee290fe5 from image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:55:59 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705f740-5db3-4e6f-9414-c8aad61d2890]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:59 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:55:59 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:59 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 1073741824" returned: 0 in 0.452s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:59 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 Sep 01 12:55:59 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:59 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:59 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.924s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117503476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19024d6-c0fb-40b8-b0f6-d511063aa0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54674b55e5054ea5906a32a1348ea860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:55Z,use_quota=True,user_id='e0259661409f4dd6a3087b9fe02d6f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Creating volume a19024d6-c0fb-40b8-b0f6-d511063aa0a2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:55:59 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:55:59 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:55:59 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:59 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 1073741824 Sep 01 12:55:59 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af1721-aa68-4d02-b019-f203cb80f190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3620eddc-22ad-4678-87ce-351fd9541db0', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab55f2db-1a5f-4e28-9b8e-f27a99296716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:55:59 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Volume volume-3620eddc-22ad-4678-87ce-351fd9541db0 (3620eddc-22ad-4678-87ce-351fd9541db0): created successfully Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab55f2db-1a5f-4e28-9b8e-f27a99296716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (a0138146-02da-40e6-97a2-d193b0dfd0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:55:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c7f58377-785c-43aa-9b8f-6f7abff3f768 tempest-CreateVolumesFromImageTest-145273842 None] Created volume successfully. Sep 01 12:55:59 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Temporary image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 is fetched for user bbcdaeec70ba4963a77c9305e8ab0139. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5374b3c9-d7f6-47e0-8245-9b89b9d2e546]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:55:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:00 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:56:00 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:00 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 1073741824" returned: 0 in 0.516s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:00 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 Sep 01 12:56:00 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:00 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:00 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:56:00 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:00 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" returned: 0 in 0.270s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.122s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860296547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d21c4cd-6ee0-4860-8845-fd9172f74991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:56Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume 1d21c4cd-6ee0-4860-8845-fd9172f74991 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:00 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:00 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 1073741824 Sep 01 12:56:00 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670e62c3-d2c6-4926-bdf1-1d06953955fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05999ed1-de1f-410a-91c9-e45f84fb7ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:00 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Volume volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 (a19024d6-c0fb-40b8-b0f6-d511063aa0a2): created successfully Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05999ed1-de1f-410a-91c9-e45f84fb7ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Flow 'volume_create_manager' (b4adc0f1-95e4-48ce-8b85-9541d7761df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-48a33db9-305c-48e9-b6dd-e560638af605 tempest-CreateVolumesFromImageTest-145273842 None] Created volume successfully. Sep 01 12:56:00 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:00 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 1073741824" returned: 0 in 0.461s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:00 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 Sep 01 12:56:00 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:01 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991" returned: 0 in 0.257s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644119363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d24931-90e8-4167-a921-a461ca3c5553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:57Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume 00d24931-90e8-4167-a921-a461ca3c5553 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:01 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-a19024d6-c0fb-40b8-b0f6-d511063aa0a2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:01 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 1073741824 Sep 01 12:56:01 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e10e63b-c20d-40a4-a6f1-a8111985ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d21c4cd-6ee0-4860-8845-fd9172f74991', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf55d314-0891-4047-b901-ffc35cf18eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-a19024d6-c0fb-40b8-b0f6-d511063aa0a2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 (1d21c4cd-6ee0-4860-8845-fd9172f74991): created successfully Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf55d314-0891-4047-b901-ffc35cf18eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (78a12274-0001-4061-b37f-61b5681ac27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:01 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f4bcac21-fa85-4191-9e58-2eb533ad2a76 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-quobyte-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a63dc2-6c1d-4cc4-b4cc-0a33d0d3517d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:01 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 Sep 01 12:56:01 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:01 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 1073741824" returned: 0 in 0.564s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:01 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 Sep 01 12:56:01 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:01 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" returned: 0 in 0.490s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:01 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2 Sep 01 12:56:01 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.619s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-274353535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ffed49-ea6e-42a5-81a3-c7aae58adf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:57Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume 95ffed49-ea6e-42a5-81a3-c7aae58adf2c {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:02 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee3c50d-5ada-41f6-8f59-5585c91a6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d24931-90e8-4167-a921-a461ca3c5553', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:02 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c 1073741824 Sep 01 12:56:02 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df15c61-8794-4283-b98b-c3b48d535b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:02 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-00d24931-90e8-4167-a921-a461ca3c5553 (00d24931-90e8-4167-a921-a461ca3c5553): created successfully Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df15c61-8794-4283-b98b-c3b48d535b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (c281b474-747f-459a-890f-52a1c65a43c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-a19024d6-c0fb-40b8-b0f6-d511063aa0a2" released by "delete_volume" :: held 0.825s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7b2de078-5c08-4259-80d2-4f63de4b2c0f tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Created reservations ['b25fc1e9-e268-4cf7-9da5-ba346eb6de9f', '5389ebae-f7d3-4a0a-b38a-82404ea04a0a', '7f71dc03-f7d4-497c-a2b3-3157fea24649', '55e92007-07a2-4f5a-be9e-0138aa64a097'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:02 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:02 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-3620eddc-22ad-4678-87ce-351fd9541db0-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-3620eddc-22ad-4678-87ce-351fd9541db0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-quobyte-3620eddc-22ad-4678-87ce-351fd9541db0" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-3620eddc-22ad-4678-87ce-351fd9541db0" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6541f25-ee00-418d-9f30-aa0a41cc4ab8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:02 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c 1073741824" returned: 0 in 0.572s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 Sep 01 12:56:02 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:02 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c Sep 01 12:56:02 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.413s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Deleted volume successfully. Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d43969d4-baef-4bc6-8c68-bbb3488e8ece tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-a19024d6-c0fb-40b8-b0f6-d511063aa0a2-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:02 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0" returned: 0 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:02 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0 Sep 01 12:56:02 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:02 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" returned: 0 in 0.278s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.538s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f5ec7-8955-4cb3-b0c1-26d0f4243bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f911a6b0-682b-4232-8b71-fe5f9f0a877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating offline snapshot 1be2af0d-8d8c-493b-9945-971994eb55d0 of volume 500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:56:03 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c (95ffed49-ea6e-42a5-81a3-c7aae58adf2c): created successfully Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f911a6b0-682b-4232-8b71-fe5f9f0a877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (ad3bf91d-91ac-47ff-9983-affc015fd411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda5032-49ad-4309-b88b-225d46ac38a2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3ab6efc2-4d85-47e1-b907-120280119257 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:56:03 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d Sep 01 12:56:03 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:03 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3620eddc-22ad-4678-87ce-351fd9541db0" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-3620eddc-22ad-4678-87ce-351fd9541db0" released by "delete_volume" :: held 0.745s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Created reservations ['35ac5195-3475-4e19-abc2-0863d317fe59', 'b0ba7bb6-9d20-42cf-8d9b-f58848f909e8', 'a57b42a1-02fe-4073-9637-27141d2fe8f7', '4cefd15c-90f2-49e4-9262-81afc25f8691'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:03 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:03 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:03 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" returned: 0 in 0.446s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:03 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 1G Sep 01 12:56:03 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-f9eeabaf-4877-4936-80bb-638550e586c8-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:03 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Deleted volume successfully. Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-f9eeabaf-4877-4936-80bb-638550e586c8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5c20014c-9b7e-4c95-9c7a-28dd16173aeb tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-3620eddc-22ad-4678-87ce-351fd9541db0-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-quobyte-f9eeabaf-4877-4936-80bb-638550e586c8" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-f9eeabaf-4877-4936-80bb-638550e586c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3f31e-f74f-4a01-9c48-c7ac2a774e2e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:03 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 Sep 01 12:56:03 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 1G" returned: 0 in 0.516s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:04 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 Sep 01 12:56:04 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:04 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8 Sep 01 12:56:04 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0" returned: 0 in 0.298s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 is being set with open permissions: ugo+rw Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:04 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 Sep 01 12:56:04 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f9eeabaf-4877-4936-80bb-638550e586c8" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-f9eeabaf-4877-4936-80bb-638550e586c8" released by "delete_volume" :: held 0.708s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Created reservations ['d9b3b8a0-c144-4f6d-9bf5-03d21fde51ee', '984ba393-8262-4d35-ab76-4c6b3ae87948', '6cb0c1fb-0830-432c-a320-7251d1f96449', '7bba8c69-d796-4149-b156-9c6467516318'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:04 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:04 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:04 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:04 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info Sep 01 12:56:04 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-14cd910f-a621-4247-90f8-52a707c449c5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:04 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-14cd910f-a621-4247-90f8-52a707c449c5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Deleted volume successfully. Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1741dd97-969c-4a0c-b9fb-27ab916bad16 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-f9eeabaf-4877-4936-80bb-638550e586c8-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-quobyte-14cd910f-a621-4247-90f8-52a707c449c5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-14cd910f-a621-4247-90f8-52a707c449c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:04 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info" returned: 0 in 0.356s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:04 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info is being set with open permissions: ugo+rw Sep 01 12:56:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bba1ae-81df-4bd5-9299-548cbf68d9f2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info Sep 01 12:56:05 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:05 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 Sep 01 12:56:05 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:05 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.info" returned: 0 in 0.254s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.430s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960281395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b1fd93-99fb-4ec4-8277-3f72e021dcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume f5b1fd93-99fb-4ec4-8277-3f72e021dcfc {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:05 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc 1073741824 Sep 01 12:56:05 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-194ddb2e-a58f-4d6d-b848-08eaec1d8574 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Create snapshot completed successfully Sep 01 12:56:05 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5 Sep 01 12:56:05 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:05 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-14cd910f-a621-4247-90f8-52a707c449c5" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-14cd910f-a621-4247-90f8-52a707c449c5" released by "delete_volume" :: held 0.713s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:05 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc 1073741824" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Created reservations ['8e473b53-b1e7-4e67-9a5f-532712b854eb', '7afba103-323f-4afe-ac65-b08aa111a759', 'd3735e40-1951-457a-988c-1a12ba51f1fe', '91327d7a-6528-4284-9178-bb543ac498ae'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc Sep 01 12:56:05 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:05 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:05 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-d36e27e8-096a-45e5-8554-5fb8ef53a84e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:06 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" returned: 0 in 0.341s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.861s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538540442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6fd133-dc83-4544-90a3-79381b738d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='363369d6e0704008b74b6ebcad33ad47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='2bd6405e89b149e7b4ad32544bd19333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Creating volume 9c6fd133-dc83-4544-90a3-79381b738d3b {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:06 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e65b702-c6a6-47f5-808e-c064b09457e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:06 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b 1073741824 Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c755891d-62ed-407d-8a5d-92db6ea2be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-d36e27e8-096a-45e5-8554-5fb8ef53a84e-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.377s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Deleted volume successfully. Sep 01 12:56:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc (f5b1fd93-99fb-4ec4-8277-3f72e021dcfc): created successfully Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c755891d-62ed-407d-8a5d-92db6ea2be02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (81420776-3f9e-4225-b604-42fd2d5dad47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f5eb6223-23c5-48af-9871-dd6be6af32cb tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "cinder-quobyte-d36e27e8-096a-45e5-8554-5fb8ef53a84e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7ae92d74-80fe-4661-b818-2269052c2ff3 tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-14cd910f-a621-4247-90f8-52a707c449c5-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-d36e27e8-096a-45e5-8554-5fb8ef53a84e" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[344e6307-683e-4eed-92ec-6c49759e53b2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:06 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e Sep 01 12:56:06 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (7cd795ab-c72f-48c1-9d50-72cdff9fa256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdeabac-ca60-48d8-9b36-d3d359eec032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdeabac-ca60-48d8-9b36-d3d359eec032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292376039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17248ee8-c311-4b56-8af4-dff37be35634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:06Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659e6401-b342-40a9-9225-1429ae705b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659e6401-b342-40a9-9225-1429ae705b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a2369f-9687-41af-bf1e-58687958325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a2369f-9687-41af-bf1e-58687958325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17248ee8-c311-4b56-8af4-dff37be35634', 'volume_name': 'volume-17248ee8-c311-4b56-8af4-dff37be35634', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7d6487-0c38-419e-a1c2-63c5d4e68706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7d6487-0c38-419e-a1c2-63c5d4e68706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe572da3-282d-4255-8d0b-646522289f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:06 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume 17248ee8-c311-4b56-8af4-dff37be35634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17248ee8-c311-4b56-8af4-dff37be35634', 'volume_size': 1} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:06 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b 1073741824" returned: 0 in 0.698s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:06 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e" returned: 0 in 0.509s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:06 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e Sep 01 12:56:06 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:06 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b Sep 01 12:56:06 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (09b35900-224a-46fb-903b-d6e0c26f1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f386d7b-933e-4814-bb25-1d47d4e2a85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f386d7b-933e-4814-bb25-1d47d4e2a85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539972689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d278e-08e2-43ed-a678-df3d598708b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:07Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f66a92-38f9-4e01-9d05-adc1d1fe38ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f66a92-38f9-4e01-9d05-adc1d1fe38ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e65f92-a733-4f45-97d3-76323ad777b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e65f92-a733-4f45-97d3-76323ad777b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544d278e-08e2-43ed-a678-df3d598708b1', 'volume_name': 'volume-544d278e-08e2-43ed-a678-df3d598708b1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692b8253-c57b-4e77-937b-237d6831de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692b8253-c57b-4e77-937b-237d6831de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b65cc9-3571-4334-9f4b-5769e10e753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume 544d278e-08e2-43ed-a678-df3d598708b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544d278e-08e2-43ed-a678-df3d598708b1', 'volume_size': 1} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:07 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b" returned: 0 in 0.391s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.751s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17ffddc-f092-46aa-8156-404bee290fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a948444e5914132b02adcc529117acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:55:58Z,use_quota=True,user_id='bbcdaeec70ba4963a77c9305e8ab0139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7529df2a-9ac6-4caa-bf97-795f559202b6),volume_type_id=7529df2a-9ac6-4caa-bf97-795f559202b6)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:07 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Creating volume d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:07 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d36e27e8-096a-45e5-8554-5fb8ef53a84e" returned: 0 in 0.481s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:07 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1073741824 Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f610d1-48ac-4288-8ae1-00d002ea35e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6fd133-dc83-4544-90a3-79381b738d3b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a65ac-0db7-4009-81ac-4e796b1bf7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-quobyte-d36e27e8-096a-45e5-8554-5fb8ef53a84e" released by "delete_volume" :: held 1.057s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Volume volume-9c6fd133-dc83-4544-90a3-79381b738d3b (9c6fd133-dc83-4544-90a3-79381b738d3b): created successfully Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656a65ac-0db7-4009-81ac-4e796b1bf7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Flow 'volume_create_manager' (c9ab396c-5379-46a7-99cf-98b5f657aa16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a96b2bf1-024e-491c-9e0b-c127d87de760 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created volume successfully. Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (c70a51c8-b634-4fa6-8a70-0f2506f311dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5b530f-70a5-43bd-8775-db611965d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5b530f-70a5-43bd-8775-db611965d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758694555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c50272-2149-457d-ba17-b4c5e15118c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:07Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfed69c-da44-4f3f-8a49-1e738ba0d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfed69c-da44-4f3f-8a49-1e738ba0d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc582d0e-edbc-4e87-a166-5a9896fe3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc582d0e-edbc-4e87-a166-5a9896fe3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c50272-2149-457d-ba17-b4c5e15118c2', 'volume_name': 'volume-a5c50272-2149-457d-ba17-b4c5e15118c2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a5c25-7a1e-45dc-8b05-8e4bae596718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a5c25-7a1e-45dc-8b05-8e4bae596718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2e310-655f-4920-8bfd-79bd97731406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume a5c50272-2149-457d-ba17-b4c5e15118c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c50272-2149-457d-ba17-b4c5e15118c2', 'volume_size': 1} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Created reservations ['437fa075-c5a9-4e9c-9dff-143d5ae06eb0', '42901817-8d04-4c9c-aa21-ea4013384ec6', 'a9bfe2af-c898-4bae-b58c-71664145b075', '19e18513-73d4-4202-a14b-ff7f78576adc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:07 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:07 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:07 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1073741824" returned: 0 in 0.632s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (52d9deaf-ffc1-473a-b48f-9c184087fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e183a319-4e67-4bbe-bac5-f898c4c91051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e183a319-4e67-4bbe-bac5-f898c4c91051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384060107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:08Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115fc6ad-9be2-4e0b-98f1-d7fa8061998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115fc6ad-9be2-4e0b-98f1-d7fa8061998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc46ccd-ef3f-4868-b201-5b78c4860534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc46ccd-ef3f-4868-b201-5b78c4860534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9', 'volume_name': 'volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d04c79-1f7c-4802-a372-281ad840f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d04c79-1f7c-4802-a372-281ad840f15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a6586-3747-419d-8c0d-32727de54d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9', 'volume_size': 1} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.363s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Deleted volume successfully. Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-cd0bf712-446c-4c1a-830c-752ede97b03e tempest-CreateVolumesFromImageTest-145273842 None] Lock "cinder-d36e27e8-096a-45e5-8554-5fb8ef53a84e-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:08 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 Sep 01 12:56:08 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:08 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (d5664420-83fe-4e3d-a30d-5a6eab348e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32207afd-4cf6-4d09-afd9-9211ba56e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-9c6fd133-dc83-4544-90a3-79381b738d3b-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5" returned: 0 in 0.349s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292376039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17248ee8-c311-4b56-8af4-dff37be35634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:06Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume 17248ee8-c311-4b56-8af4-dff37be35634 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:08 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32207afd-4cf6-4d09-afd9-9211ba56e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035338804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:08Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77748300-4aff-47cf-93ef-ffce2a2890f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77748300-4aff-47cf-93ef-ffce2a2890f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 1073741824 Sep 01 12:56:08 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32508f73-cb72-4366-810e-4d32d9454db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32508f73-cb72-4366-810e-4d32d9454db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8', 'volume_name': 'volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e03dd-e7e6-4da6-878d-926cdfbe2405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7e03dd-e7e6-4da6-878d-926cdfbe2405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19460ccf-69c2-46ea-87ae-e9c3eec052e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8', 'volume_size': 1} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-9c6fd133-dc83-4544-90a3-79381b738d3b-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Attempting download of 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}])) to volume d17ffddc-f092-46aa-8156-404bee290fe5. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-9c6fd133-dc83-4544-90a3-79381b738d3b" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-9c6fd133-dc83-4544-90a3-79381b738d3b" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfbf104-83b3-4d0d-b33b-a4cf8d838bd6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991c96c-402b-45c3-bb4c-b67d6a33084a]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:08 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b Sep 01 12:56:08 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:08 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7 Sep 01 12:56:08 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 1073741824" returned: 0 in 0.582s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b" returned: 0 in 0.477s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 Sep 01 12:56:09 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b Sep 01 12:56:09 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7 Sep 01 12:56:09 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-9c6fd133-dc83-4544-90a3-79381b738d3b" returned: 0 in 0.340s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-9c6fd133-dc83-4544-90a3-79381b738d3b" released by "delete_volume" :: held 0.879s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:09 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7" returned: 1 in 0.452s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_506kqjn7' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6904ea4c-7dbd-4763-8e11-b8fa40211d7d]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634" returned: 0 in 0.431s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.361s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539972689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d278e-08e2-43ed-a678-df3d598708b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:07Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume 544d278e-08e2-43ed-a678-df3d598708b1 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:09 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe572da3-282d-4255-8d0b-646522289f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17248ee8-c311-4b56-8af4-dff37be35634', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:09 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 1073741824 Sep 01 12:56:09 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f7cd2b-1ca9-4ecc-85c9-8be1836b85c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-17248ee8-c311-4b56-8af4-dff37be35634 (17248ee8-c311-4b56-8af4-dff37be35634): created successfully Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f7cd2b-1ca9-4ecc-85c9-8be1836b85c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (7cd795ab-c72f-48c1-9d50-72cdff9fa256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:09 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:56:09 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['6d2b704a-c8f8-4f8b-8407-d9562511c55f', '06035799-6585-4063-9e13-e1c4e5f1d547', '02a139a1-52cb-410b-90ee-cf89c3bd4b71', 'a5f7bfb7-ec8c-4a52-ad03-3d32470205c4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-736f1938-cfa6-4778-945f-9bc286ff6fcc tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:09 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:09 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:09 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:10 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.386s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:10 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD Sep 01 12:56:10 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:10 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 1073741824" returned: 0 in 0.642s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1a28cf67-42ec-4558-bd86-3d9f91f54163 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-9c6fd133-dc83-4544-90a3-79381b738d3b-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:10 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 was raw, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:10 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 Sep 01 12:56:10 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:10 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 Sep 01 12:56:10 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:10 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.124s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1758694555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c50272-2149-457d-ba17-b4c5e15118c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:07Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume a5c50272-2149-457d-ba17-b4c5e15118c2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:10 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:10 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 1073741824 Sep 01 12:56:10 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b65cc9-3571-4334-9f4b-5769e10e753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544d278e-08e2-43ed-a678-df3d598708b1', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8764134-af02-45e9-a993-afc64c11ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-544d278e-08e2-43ed-a678-df3d598708b1 (544d278e-08e2-43ed-a678-df3d598708b1): created successfully Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8764134-af02-45e9-a993-afc64c11ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (09b35900-224a-46fb-903b-d6e0c26f1369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-73fc4bc7-9c15-40e9-ab42-017283dcd232 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf3e09-681b-4566-9a74-944e1ebfa907]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:11 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc Sep 01 12:56:11 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:11 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5" returned: 0 in 0.686s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a38ffdd-10e9-48c5-ba5e-46fb51c81776_gdw_tjwvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:11 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1G Sep 01 12:56:11 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:11 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 1073741824" returned: 0 in 0.598s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:11 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" returned: 0 in 0.464s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:11 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 Sep 01 12:56:11 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:11 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc Sep 01 12:56:11 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:11 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 1G" returned: 0 in 0.449s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Downloaded image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}])) to volume d17ffddc-f092-46aa-8156-404bee290fe5 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Temporary image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 for user bbcdaeec70ba4963a77c9305e8ab0139 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Marking volume d17ffddc-f092-46aa-8156-404bee290fe5 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Copying metadata from image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 to d17ffddc-f092-46aa-8156-404bee290fe5. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Creating volume glance metadata for volume d17ffddc-f092-46aa-8156-404bee290fe5 backed by image 6a38ffdd-10e9-48c5-ba5e-46fb51c81776 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'af0b41f5cf8bf35f63b6821086f161f5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:56:11 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.661s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:11 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384060107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:08Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:11 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 1073741824 Sep 01 12:56:11 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2e310-655f-4920-8bfd-79bd97731406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c50272-2149-457d-ba17-b4c5e15118c2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468ad908-59e4-44e7-97e4-74c9de616517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc" released by "delete_volume" :: held 0.898s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99294b4-fd47-4774-b50e-f586987a3008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17ffddc-f092-46aa-8156-404bee290fe5', 'volume_size': 1, 'image_id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0b41f5cf8bf35f63b6821086f161f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a948444e5914132b02adcc529117acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a1ae31973c6f0ab1c4ba953e01da01399a1bd5eee85cb83b850715162c219db489dd705d0f970989b1a0591ab0a7978fa9cfcb1a44b9a7a1ba27622057b8b6af', 'id': '6a38ffdd-10e9-48c5-ba5e-46fb51c81776', 'created_at': datetime.datetime(2026, 9, 1, 10, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 55, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a38ffdd-10e9-48c5-ba5e-46fb51c81776/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d65e5a6-a5aa-4c75-beb6-9514c7c96208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-a5c50272-2149-457d-ba17-b4c5e15118c2 (a5c50272-2149-457d-ba17-b4c5e15118c2): created successfully Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468ad908-59e4-44e7-97e4-74c9de616517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (c70a51c8-b634-4fa6-8a70-0f2506f311dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Volume volume-d17ffddc-f092-46aa-8156-404bee290fe5 (d17ffddc-f092-46aa-8156-404bee290fe5): created successfully Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d65e5a6-a5aa-4c75-beb6-9514c7c96208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Flow 'volume_create_manager' (c8d1f1ab-ad40-4b61-992b-19e81b73376f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a6ac3b32-8d40-476b-85fa-b204ea8c193b tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:56:11 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e649c37f-f1ab-48be-afbd-0defbda8a187 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Created volume successfully. Sep 01 12:56:11 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['229e5605-6cf7-4ffc-86f4-6a3937388524', '9f0127fa-fb35-4342-884c-a458540ec024', '0482a4e1-5ee8-4a38-b743-39823592d529', 'b164b956-106d-4fcf-8beb-62f6e4a1fd18'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:12 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:12 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:12 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 1073741824" returned: 0 in 0.539s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:12 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:12 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 Sep 01 12:56:12 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bead2674-18ad-49b1-b6eb-174645a898b9 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-f5b1fd93-99fb-4ec4-8277-3f72e021dcfc-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:12 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.069s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2035338804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1559a002544521b721977bb3067417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:08Z,use_quota=True,user_id='99b7c372c352455797176040116625cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Creating volume e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:12 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:12 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 1073741824 Sep 01 12:56:12 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a6586-3747-419d-8c0d-32727de54d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebd311-f31e-4020-96ae-0eca3e6bffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:12 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 (ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9): created successfully Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebd311-f31e-4020-96ae-0eca3e6bffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (52d9deaf-ffc1-473a-b48f-9c184087fc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a12f21c6-b3f9-4a44-8d72-645fad68bf08 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Acquiring lock "cinder-d17ffddc-f092-46aa-8156-404bee290fe5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "cinder-d17ffddc-f092-46aa-8156-404bee290fe5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Acquiring lock "cinder-quobyte-d17ffddc-f092-46aa-8156-404bee290fe5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "cinder-quobyte-d17ffddc-f092-46aa-8156-404bee290fe5" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa821ec1-afa0-46d3-927c-abe62315c98b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-95ffed49-ea6e-42a5-81a3-c7aae58adf2c-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-95ffed49-ea6e-42a5-81a3-c7aae58adf2c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:13 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 Sep 01 12:56:13 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6f293-2d30-4118-8aea-5b569a433cf2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:13 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 1073741824" returned: 0 in 0.698s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:13 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c Sep 01 12:56:13 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:13 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 Sep 01 12:56:13 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:13 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5" returned: 0 in 0.481s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:13 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5 Sep 01 12:56:13 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:13 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" returned: 0 in 0.313s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:13 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19460ccf-69c2-46ea-87ae-e9c3eec052e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023262da-dd3f-4610-9da6-1ede873f23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" returned: 0 in 0.490s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:13 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Volume volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 (e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8): created successfully Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023262da-dd3f-4610-9da6-1ede873f23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:13 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c Sep 01 12:56:13 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Flow 'volume_create_manager' (d5664420-83fe-4e3d-a30d-5a6eab348e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-dd3fc127-de7b-4137-b88c-2c0189144bf4 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created volume successfully. Sep 01 12:56:13 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d17ffddc-f092-46aa-8156-404bee290fe5" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "cinder-quobyte-d17ffddc-f092-46aa-8156-404bee290fe5" released by "delete_volume" :: held 0.888s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Created reservations ['e693dc30-1c17-4016-8c7b-634a6aa37bba', 'f39a31ca-362e-408d-aa81-2844e649e4af', '97e15112-4776-494d-b3f8-d053d64913b6', '06ca0d69-1193-41ed-849b-1a4815feebf3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:14 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:14 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:14 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" returned: 0 in 0.319s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-95ffed49-ea6e-42a5-81a3-c7aae58adf2c" released by "delete_volume" :: held 0.866s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['8d6c68df-a8d9-4fbb-83f0-405d06f95988', 'aec09300-4921-410d-bd8e-b36e50ac411b', '4e00d273-d7f1-4cf3-82ba-5b4ec3bbf33f', '70682510-dbba-4f26-bd75-ccb126aa6455'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-00d24931-90e8-4167-a921-a461ca3c5553-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:14 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:14 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:14 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.439s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-00d24931-90e8-4167-a921-a461ca3c5553-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Deleted volume successfully. Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22af1be9-56ce-4028-aa60-54d6fb8f0ac5 tempest-VolumeAndVolumeTypeFromImageTest-1347951668 None] Lock "cinder-d17ffddc-f092-46aa-8156-404bee290fe5-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-00d24931-90e8-4167-a921-a461ca3c5553" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-00d24931-90e8-4167-a921-a461ca3c5553" acquired by "delete_volume" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b1dd84-36c2-4531-bf38-c2e35de6807c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f8e1f-27ca-41b7-b8ab-918dbd607390]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:14 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:14 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 Sep 01 12:56:14 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3c488b6f-3539-4880-abcf-0da0ec086bd6 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-95ffed49-ea6e-42a5-81a3-c7aae58adf2c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:14 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 Sep 01 12:56:14 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:15 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" returned: 0 in 0.542s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:15 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553" returned: 0 in 0.535s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:15 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8 Sep 01 12:56:15 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:15 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553 Sep 01 12:56:15 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:15 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:15 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-00d24931-90e8-4167-a921-a461ca3c5553" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8" released by "delete_volume" :: held 0.936s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-00d24931-90e8-4167-a921-a461ca3c5553" released by "delete_volume" :: held 0.930s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['196969f3-8d0f-43b8-9429-79a9b0d303b5', '96c393d4-06a1-4137-accb-27d01f6110e2', '17e5ad92-b34f-487a-8054-023a0230edd3', '6cdd2a84-32e6-4942-8c21-92169e62f499'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['a9313463-e549-437c-a624-348c9e21bd45', '3ee2b353-1b35-4ebb-bbd5-e0e8b482c677', '5f5155a9-59a8-4999-91fe-423be4129914', '08112714-3448-4dae-ab9d-cafb31f7794b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:15 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:15 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:15 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:15 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:16 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.360s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-fa3e4138-3dd0-406a-8175-e8d222504d10 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-e2ad20b6-b7a7-4b8a-83ce-8e144502a4e8-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:16 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.383s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-5d8e4b6b-9b01-407a-bee7-be76c4c8ae20 tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-00d24931-90e8-4167-a921-a461ca3c5553-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Flow 'volume_create_manager' (8ec21f1f-1c96-411b-8ee1-3e52629457d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbe43cb-9219-40bf-a3c0-8a88113a4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbe43cb-9219-40bf-a3c0-8a88113a4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ef9e37-dd32-466a-8f32-cf52c3b12563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b97c7de76d4bf897e6c49e11d1f272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:16Z,use_quota=True,user_id='ccd0e094d7a34f07b7b5462416f862a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ff348e-8b70-47a3-9fa5-b2faaa2f3cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ff348e-8b70-47a3-9fa5-b2faaa2f3cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5226f0a1-d93e-4e5f-b5c9-2b2fe14be735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.image.glance [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Creating Keystone auth plugin from conf {{(pid=87008) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-1d21c4cd-6ee0-4860-8845-fd9172f74991-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-1d21c4cd-6ee0-4860-8845-fd9172f74991-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" acquired by "delete_volume" :: waited 0.024s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-1d21c4cd-6ee0-4860-8845-fd9172f74991" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656d13f-f783-459e-88be-54fcc2931ee7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-1d21c4cd-6ee0-4860-8845-fd9172f74991" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[89adcb8e-3f6a-4f8e-ab90-6043d3a27627]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:16 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 Sep 01 12:56:16 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 Sep 01 12:56:17 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5226f0a1-d93e-4e5f-b5c9-2b2fe14be735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7ef9e37-dd32-466a-8f32-cf52c3b12563', 'volume_name': 'volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563', 'volume_size': 1, 'image_id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4d13d1da3ebc899d8425cd787d02f12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01b97c7de76d4bf897e6c49e11d1f272', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a232b7e33e172029798a77394ee185e49b0d5b652fab463121d1a06f562a57d11ff22257403dd08672191bf8f9afb6153b5fe8477b46b6b7996c981ec180db', 'id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'created_at': datetime.datetime(2026, 9, 1, 10, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3e502-7a17-41df-9a7c-ad5351c94351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3e502-7a17-41df-9a7c-ad5351c94351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:17 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8dc2ac-4114-4236-97e3-1ac1445119d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Volume d7ef9e37-dd32-466a-8f32-cf52c3b12563: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563', 'volume_size': 1, 'image_id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4d13d1da3ebc899d8425cd787d02f12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01b97c7de76d4bf897e6c49e11d1f272', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a232b7e33e172029798a77394ee185e49b0d5b652fab463121d1a06f562a57d11ff22257403dd08672191bf8f9afb6153b5fe8477b46b6b7996c981ec180db', 'id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'created_at': datetime.datetime(2026, 9, 1, 10, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b/file', 'properties': {}}, 'image_service': } Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Trying to clone d7ef9e37-dd32-466a-8f32-cf52c3b12563 from image 48522d66-0ec2-432d-bc5c-d39ac7230f4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}]). {{(pid=87008) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" returned: 0 in 0.480s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:17 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9 Sep 01 12:56:17 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991" returned: 0 in 0.538s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 12:56:17 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Image download 0.00 MB at 0.00 MB/s Sep 01 12:56:17 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991 Sep 01 12:56:17 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4461b7c-b14c-4f68-b781-77a441322d6a]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:17 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" returned: 0 in 0.331s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9" released by "delete_volume" :: held 0.882s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:17 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:17 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['3f2892ea-3017-44e7-a780-4ade8af8d650', 'fc117d5a-b7f8-4dfc-a779-e493dbd0c9cb', '2ea0a7a7-c64d-4bb9-982c-68c2fe814704', '15d89a8b-0cb8-4957-a03c-4cee0b7a0fdd'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:17 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-1d21c4cd-6ee0-4860-8845-fd9172f74991" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-1d21c4cd-6ee0-4860-8845-fd9172f74991" released by "delete_volume" :: held 0.923s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['57e2bd36-2dea-4693-9a85-68c431f30506', '7327fa29-50cb-4724-984f-834004a866ce', '78a8b224-3a08-4b45-a8ca-02524f218afb', 'beaf3252-ad80-4c12-864d-90c72ecdfcc9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:17 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:17 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:17 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-a5c50272-2149-457d-ba17-b4c5e15118c2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-a5c50272-2149-457d-ba17-b4c5e15118c2-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:18 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:18 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-a5c50272-2149-457d-ba17-b4c5e15118c2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:18 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:18 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-a5c50272-2149-457d-ba17-b4c5e15118c2" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:18 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a359ac-d698-4c62-89c5-f085e792f2a6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.359s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4c892724-30c0-42c5-bc19-760d32323144 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-ee2340f7-ae6c-454e-a6a5-4dc8f351b7a9-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:18 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Temporary image 48522d66-0ec2-432d-bc5c-d39ac7230f4b is fetched for user ccd0e094d7a34f07b7b5462416f862a8. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 12:56:18 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 Sep 01 12:56:18 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:18 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.361s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-58c820c9-ce1f-4a59-98d5-2d73b452f55a tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-1d21c4cd-6ee0-4860-8845-fd9172f74991-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f4a33-7a5e-4cc6-a607-5043079b65c9]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:18 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:18 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:18 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2" returned: 0 in 0.519s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:18 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2 Sep 01 12:56:18 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:18 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:19 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a5c50272-2149-457d-ba17-b4c5e15118c2" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:19 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:19 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-231659c2-acaa-4e24-9f8d-7527ac574a62-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-a5c50272-2149-457d-ba17-b4c5e15118c2" released by "delete_volume" :: held 0.908s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-231659c2-acaa-4e24-9f8d-7527ac574a62-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "cinder-quobyte-231659c2-acaa-4e24-9f8d-7527ac574a62" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-231659c2-acaa-4e24-9f8d-7527ac574a62" acquired by "delete_volume" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['3fbdd069-af52-45e3-8373-eab7c1e3e1d4', '86c96623-16f5-4256-b761-02ae15e9f578', '8d92af54-3c76-4d85-8067-d11aba111537', '8bbc9279-10dd-476b-8968-87738887f9a7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3089c9-8e2c-4a5e-8bdc-26a4f58144fd]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:19 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ef9e37-dd32-466a-8f32-cf52c3b12563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b97c7de76d4bf897e6c49e11d1f272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:16Z,use_quota=True,user_id='ccd0e094d7a34f07b7b5462416f862a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Creating volume d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:19 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:19 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:19 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:19 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 Sep 01 12:56:19 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:19 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1073741824 Sep 01 12:56:19 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:19 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.319s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-57cfb5e5-a9cc-4813-a928-5789b5b81cb5 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-a5c50272-2149-457d-ba17-b4c5e15118c2-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:19 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62" returned: 0 in 0.501s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:19 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62 Sep 01 12:56:19 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:19 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1073741824" returned: 0 in 0.540s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:20 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 Sep 01 12:56:20 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:20 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-231659c2-acaa-4e24-9f8d-7527ac574a62" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-quobyte-231659c2-acaa-4e24-9f8d-7527ac574a62" released by "delete_volume" :: held 0.835s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Created reservations ['970c7b13-b45e-4704-a1ef-9823928fabab', '97ff86c4-596b-49c3-85ce-126575699a55', '01dd7001-21bf-473c-a05e-9a2c324f0d2a', '232c855d-a5e2-4559-8735-5bc5dbf35da4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:20 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:20 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:20 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563" returned: 0 in 0.296s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Attempting download of 48522d66-0ec2-432d-bc5c-d39ac7230f4b ((None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}])) to volume d7ef9e37-dd32-466a-8f32-cf52c3b12563. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[12973c15-6b22-4415-bf6d-3bc7d7f9fbbe]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-544d278e-08e2-43ed-a678-df3d598708b1-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-544d278e-08e2-43ed-a678-df3d598708b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-544d278e-08e2-43ed-a678-df3d598708b1" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-544d278e-08e2-43ed-a678-df3d598708b1" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:20 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Deleted volume successfully. Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b4e7a-0394-404d-89b2-8d732c47e550]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:20 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv Sep 01 12:56:20 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-68c621fa-e779-430a-a035-931be2adb23c tempest-CreateVolumesFromSourceVolumeTest-406662397 None] Lock "cinder-231659c2-acaa-4e24-9f8d-7527ac574a62-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:20 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 Sep 01 12:56:20 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:20 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv" returned: 0 in 0.571s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:21 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv Sep 01 12:56:21 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:21 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1" returned: 0 in 0.507s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:21 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1 Sep 01 12:56:21 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:21 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv" returned: 1 in 0.401s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48522d66-0ec2-432d-bc5c-d39ac7230f4b_4i5k5jqv' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a1039-d66d-4e29-bb3b-661df62281ec]: (4, 'raw') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:21 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-544d278e-08e2-43ed-a678-df3d598708b1" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-544d278e-08e2-43ed-a678-df3d598708b1" released by "delete_volume" :: held 0.900s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['ab6c5731-0f9f-41e5-94c5-8698831e9478', 'c70a9f76-5073-45af-a2a8-63a7332f3b11', '181f79df-1e5a-408a-9d32-7400b96f0adf', '084ee85d-70a5-419e-bbde-278b8d243280'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:21 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:21 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:21 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:21 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-17248ee8-c311-4b56-8af4-dff37be35634-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-17248ee8-c311-4b56-8af4-dff37be35634-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-17248ee8-c311-4b56-8af4-dff37be35634" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-17248ee8-c311-4b56-8af4-dff37be35634" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:21 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a14f4-d3b2-4f96-b614-7e687007d59e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:22 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.440s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:22 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD Sep 01 12:56:22 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-4d975196-4f0e-4687-977b-cfb446849bee tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-544d278e-08e2-43ed-a678-df3d598708b1-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:22 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 Sep 01 12:56:22 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:22 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] 48522d66-0ec2-432d-bc5c-d39ac7230f4b was raw, converting to qcow2 {{(pid=87008) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:22 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 Sep 01 12:56:22 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:22 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634" returned: 0 in 0.568s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:22 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634 Sep 01 12:56:22 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:22 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-17248ee8-c311-4b56-8af4-dff37be35634" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-17248ee8-c311-4b56-8af4-dff37be35634" released by "delete_volume" :: held 1.011s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:22 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['c1551418-6d7d-42df-bc2a-9141fafcb35b', '12844528-bc12-414d-8801-30a9235bf41f', '4f221b96-4beb-40eb-b528-fb7445be6c01', 'a9a81f66-5b15-413e-a4f7-6784561320cd'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:23 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563" returned: 0 in 0.757s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48522d66-0ec2-432d-bc5c-d39ac7230f4b_27rnxocedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:56:23 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:23 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:23 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:23 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1G Sep 01 12:56:23 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:23 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.309s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-584fcf7e-353c-4082-82dd-d0b49b08425d tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-17248ee8-c311-4b56-8af4-dff37be35634-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:23 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 1G" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Downloaded image 48522d66-0ec2-432d-bc5c-d39ac7230f4b ((None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}])) to volume d7ef9e37-dd32-466a-8f32-cf52c3b12563 successfully. {{(pid=87008) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Temporary image 48522d66-0ec2-432d-bc5c-d39ac7230f4b for user ccd0e094d7a34f07b7b5462416f862a8 is deleted. {{(pid=87008) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.volume_utils [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Marking volume d7ef9e37-dd32-466a-8f32-cf52c3b12563 as bootable. {{(pid=87008) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Copying metadata from image 48522d66-0ec2-432d-bc5c-d39ac7230f4b to d7ef9e37-dd32-466a-8f32-cf52c3b12563. {{(pid=87008) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Creating volume glance metadata for volume d7ef9e37-dd32-466a-8f32-cf52c3b12563 backed by image 48522d66-0ec2-432d-bc5c-d39ac7230f4b with: {'image_id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c4d13d1da3ebc899d8425cd787d02f12', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87008) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8dc2ac-4114-4236-97e3-1ac1445119d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563', 'volume_size': 1, 'image_id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4d13d1da3ebc899d8425cd787d02f12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01b97c7de76d4bf897e6c49e11d1f272', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a232b7e33e172029798a77394ee185e49b0d5b652fab463121d1a06f562a57d11ff22257403dd08672191bf8f9afb6153b5fe8477b46b6b7996c981ec180db', 'id': '48522d66-0ec2-432d-bc5c-d39ac7230f4b', 'created_at': datetime.datetime(2026, 9, 1, 10, 56, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 10, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48522d66-0ec2-432d-bc5c-d39ac7230f4b/file', 'properties': {}}, 'image_service': }' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4a977-dec2-4afb-99ce-0aa89f005940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Volume volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 (d7ef9e37-dd32-466a-8f32-cf52c3b12563): created successfully Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4a977-dec2-4afb-99ce-0aa89f005940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Flow 'volume_create_manager' (8ec21f1f-1c96-411b-8ee1-3e52629457d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cffe2b31-0b28-4473-bcc8-b3917d9f2edb tempest-VolumeImageDependencyTests-1804578777 None] Created volume successfully. Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-1be2af0d-8d8c-493b-9945-971994eb55d0-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-1be2af0d-8d8c-493b-9945-971994eb55d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-1be2af0d-8d8c-493b-9945-971994eb55d0" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-1be2af0d-8d8c-493b-9945-971994eb55d0" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleting offline snapshot 1be2af0d-8d8c-493b-9945-971994eb55d0 of volume 500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] snapshot_file for this snap is: volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[94079aaf-1fcb-47e3-89c6-68261d85248a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Flow 'volume_create_manager' (789cd05b-af75-45e7-8404-dc1c9d0d65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:24 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 Sep 01 12:56:24 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74625-881b-4ebb-a0ab-7a8b51a30a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74625-881b-4ebb-a0ab-7a8b51a30a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1283598817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973cd706-e544-4b36-b4d4-b87dd0265779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca7c97e7be343de9511145fedac833d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:24Z,use_quota=True,user_id='b8f2adfa1dbf468f82580f2fc63816e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871c04f4-f35b-4c10-b8fc-be1524c2e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871c04f4-f35b-4c10-b8fc-be1524c2e009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1267ef6-3f1e-4db4-9448-b89d60b67a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1267ef6-3f1e-4db4-9448-b89d60b67a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973cd706-e544-4b36-b4d4-b87dd0265779', 'volume_name': 'volume-973cd706-e544-4b36-b4d4-b87dd0265779', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228a000f-42e9-4aee-9ea0-4d9091c0819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228a000f-42e9-4aee-9ea0-4d9091c0819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861b0624-57c1-4c0f-b95b-60b809e007d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Volume 973cd706-e544-4b36-b4d4-b87dd0265779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973cd706-e544-4b36-b4d4-b87dd0265779', 'volume_size': 1} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1283598817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973cd706-e544-4b36-b4d4-b87dd0265779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca7c97e7be343de9511145fedac833d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:24Z,use_quota=True,user_id='b8f2adfa1dbf468f82580f2fc63816e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Creating volume 973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:24 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Acquiring lock "cinder-d7ef9e37-dd32-466a-8f32-cf52c3b12563-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:24 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 1073741824 Sep 01 12:56:24 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "cinder-d7ef9e37-dd32-466a-8f32-cf52c3b12563-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Acquiring lock "cinder-quobyte-d7ef9e37-dd32-466a-8f32-cf52c3b12563" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "cinder-quobyte-d7ef9e37-dd32-466a-8f32-cf52c3b12563" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:24 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccabd45-70c0-4b94-ae66-8f76a2a87f47]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0" returned: 0 in 0.584s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf69d4-8e4e-4176-8af5-b78b675a53a4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:24 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 Sep 01 12:56:24 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d Sep 01 12:56:25 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 1073741824" returned: 0 in 0.648s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:25 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:25 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563" returned: 0 in 0.488s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:25 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563 Sep 01 12:56:25 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" returned: 0 in 0.547s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:25 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 Sep 01 12:56:25 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.350s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:25 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d7ef9e37-dd32-466a-8f32-cf52c3b12563" returned: 0 in 0.320s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861b0624-57c1-4c0f-b95b-60b809e007d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973cd706-e544-4b36-b4d4-b87dd0265779', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3720a-9e21-46d0-9056-12069242c94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "cinder-quobyte-d7ef9e37-dd32-466a-8f32-cf52c3b12563" released by "delete_volume" :: held 0.899s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:25 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Volume volume-973cd706-e544-4b36-b4d4-b87dd0265779 (973cd706-e544-4b36-b4d4-b87dd0265779): created successfully Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3720a-9e21-46d0-9056-12069242c94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Flow 'volume_create_manager' (789cd05b-af75-45e7-8404-dc1c9d0d65af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-51ee7014-a270-4ec5-a80c-dd952ec9843b tempest-VolumeDependencyTests-1747773208 None] Created volume successfully. Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Created reservations ['77c51cbb-c138-40b4-b901-a015b0f6c0bf', '34e92b4a-c07e-48d1-b616-bea2a93b1386', '7649acea-0092-430f-8771-e56b5f6d7cb4', '0bd713b3-f9a3-41b0-83ac-4e148a79682a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:25 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:25 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:25 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0" returned: 0 in 0.406s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:25 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0 Sep 01 12:56:25 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:26 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Deleted volume successfully. Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-319248ac-0d6c-40d7-beee-37e91cb85034 tempest-VolumeImageDependencyTests-1804578777 None] Lock "cinder-d7ef9e37-dd32-466a-8f32-cf52c3b12563-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:26 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d.1be2af0d-8d8c-493b-9945-971994eb55d0" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-1be2af0d-8d8c-493b-9945-971994eb55d0" released by "_delete_snapshot" :: held 2.001s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" released by "delete_snapshot" :: held 2.054s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['e6a9e3b2-0bff-4e6a-bdd8-2d6956239bf4', '0179301f-545a-43d1-bc94-232d2c3e4938', '75da84ca-9a80-4a96-8c61-8001884bd0cd', '8934abdf-d51b-4747-9f70-47cfc94a7ea0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Delete snapshot completed successfully. Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-dbf395ad-54a2-4599-b3d0-26dd532eb906 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-1be2af0d-8d8c-493b-9945-971994eb55d0-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:26 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:26 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Creating offline snapshot 2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de of volume 973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[43900134-8db4-4af6-a99c-e54d0f65069a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:26 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:26 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:27 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:27 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.616s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:27 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de 1G Sep 01 12:56:27 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4bf45-f452-4b51-bdc4-51125525ed7e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:27 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d Sep 01 12:56:27 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:28 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de 1G" returned: 0 in 0.600s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973cd706-e544-4b36-b4d4-b87dd0265779 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:28 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" returned: 0 in 0.536s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:28 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973cd706-e544-4b36-b4d4-b87dd0265779 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:28 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:28 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d Sep 01 12:56:28 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:28 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" returned: 0 in 0.378s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-quobyte-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d" released by "delete_volume" :: held 1.022s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:28 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973cd706-e544-4b36-b4d4-b87dd0265779 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:28 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de is being set with open permissions: ugo+rw Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:28 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:28 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Created reservations ['3fbc20a1-823f-4633-b385-628c27319f5d', 'fea18acf-2ae8-4cb6-bf9e-aea5257d943b', 'b05826f9-c2fc-48b1-8884-948fc78b0306', 'a0ac2318-d412-4243-89e4-64ead126417a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:28 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:28 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:28 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.340s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:28 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info Sep 01 12:56:28 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:29 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.390s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Deleted volume successfully. Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-7f6b2bc9-51eb-4f3d-b3cf-d7d6ab88eb66 tempest-CreateVolumesFromSnapshotTest-1345864414 None] Lock "cinder-500da4b1-ec9c-4ecb-82bb-9c84ef5b181d-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:29 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info" returned: 0 in 0.339s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:29 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info is being set with open permissions: ugo+rw Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:29 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info Sep 01 12:56:29 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:29 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.info" returned: 0 in 0.293s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f48e5ca-6d7b-40d7-8c1b-1f62276c2f5a tempest-VolumeDependencyTests-1747773208 None] Create snapshot completed successfully Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Flow 'volume_create_manager' (bfcf836a-41f2-42a7-ac8a-da063af0ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28701fa-7844-4eef-8096-4650921ce8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28701fa-7844-4eef-8096-4650921ce8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-632892775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca7c97e7be343de9511145fedac833d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:30Z,use_quota=True,user_id='b8f2adfa1dbf468f82580f2fc63816e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8ab42d-28aa-4792-858f-43f1752dbb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8ab42d-28aa-4792-858f-43f1752dbb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6e70c8-0e4b-43ca-9704-8a8a1c4e1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6e70c8-0e4b-43ca-9704-8a8a1c4e1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c', 'volume_name': 'volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c', 'volume_size': 1, 'snapshot_id': '2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34d4e3a-e705-47a1-b44b-842d00199eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34d4e3a-e705-47a1-b44b-842d00199eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0cc6af-038f-49d4-a230-6e1517381040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Volume 25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c', 'volume_size': 1, 'snapshot_id': '2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de'} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Creating volume 25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c from snapshot 2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] snapshot: 2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de, volume: 25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f7814-d4bc-441b-815e-9ab49d06643b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:31 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:31 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:31 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.531s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-973cd706-e544-4b36-b4d4-b87dd0265779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[58249b33-b7f2-400d-9321-68124057cdd0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:31 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:31 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:31 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.501s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:56:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:31 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c Sep 01 12:56:31 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Flow 'volume_create_manager' (c79f8154-6e43-4341-bff5-dec116b7c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272fe77e-2bc5-450e-a76f-524dc97d3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272fe77e-2bc5-450e-a76f-524dc97d3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66301354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce8e525-3bb1-4677-8bb6-353d98ac724b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e732ca75cf5c40be97353c9df68bed55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:33Z,use_quota=True,user_id='404f266a0ab14a10bc29a886f5aa085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04fa199-82a7-4c08-b45f-d60e16674bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04fa199-82a7-4c08-b45f-d60e16674bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57637a-fd0c-4f3a-b2f9-caf1bb2e46e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57637a-fd0c-4f3a-b2f9-caf1bb2e46e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce8e525-3bb1-4677-8bb6-353d98ac724b', 'volume_name': 'volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a7b44-0ea6-4ae7-84a4-a959595b2478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a7b44-0ea6-4ae7-84a4-a959595b2478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3472f4b6-b8b1-4e5f-918b-365eb4277d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:33 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Volume 3ce8e525-3bb1-4677-8bb6-353d98ac724b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b', 'volume_size': 1} Sep 01 12:56:33 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Flow 'volume_create_manager' (5e306839-deac-47d9-a5e7-0674a4c55f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3dfdda-1d84-46eb-925d-d3941f7b626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3dfdda-1d84-46eb-925d-d3941f7b626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035647c-1f60-418c-9619-f7ef9075225f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf7acf9f4cb4418977962e87352fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:36Z,use_quota=True,user_id='e69e5bdd30474fcca90ca86b64a78b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd21c7a-dc6f-45b1-bce3-0de5a1f2cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd21c7a-dc6f-45b1-bce3-0de5a1f2cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec99b50-4081-4754-b0c2-401f38a2aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec99b50-4081-4754-b0c2-401f38a2aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3035647c-1f60-418c-9619-f7ef9075225f', 'volume_name': 'volume-3035647c-1f60-418c-9619-f7ef9075225f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d8201-5fa4-4894-85e6-df98ab65dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d8201-5fa4-4894-85e6-df98ab65dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f15e8c-fed6-4930-a6c7-b347fb2966d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Volume 3035647c-1f60-418c-9619-f7ef9075225f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3035647c-1f60-418c-9619-f7ef9075225f', 'volume_size': 1} Sep 01 12:56:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:37 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" returned: 0 in 5.865s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:37 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:56:37 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Converted 1024.00 MB image at 174.54 MB/s Sep 01 12:56:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c is being set with open permissions: ugo+rw Sep 01 12:56:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:37 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c Sep 01 12:56:37 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:38 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" released by "_copy_volume_from_snapshot" :: held 7.292s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" released by "_create_volume_from_snapshot" :: held 7.367s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.389s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.323s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66301354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce8e525-3bb1-4677-8bb6-353d98ac724b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e732ca75cf5c40be97353c9df68bed55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:33Z,use_quota=True,user_id='404f266a0ab14a10bc29a886f5aa085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Creating volume 3ce8e525-3bb1-4677-8bb6-353d98ac724b {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:38 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b 1073741824 Sep 01 12:56:38 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0cc6af-038f-49d4-a230-6e1517381040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c', 'volume_size': 1, 'snapshot_id': '2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8942956-0067-4dca-8867-dbb7e7e99fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Volume volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c (25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c): created successfully Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8942956-0067-4dca-8867-dbb7e7e99fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Flow 'volume_create_manager' (bfcf836a-41f2-42a7-ac8a-da063af0ffce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e9c974e6-e254-4dae-a9f7-4ec0026002d2 tempest-VolumeDependencyTests-1747773208 None] Created volume successfully. Sep 01 12:56:38 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b 1073741824" returned: 0 in 0.460s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:38 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b Sep 01 12:56:38 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Deleting offline snapshot 2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de of volume 973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] snapshot_file for this snap is: volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadb516-45a4-4945-8c6c-5be53e52bf62]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:38 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035647c-1f60-418c-9619-f7ef9075225f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf7acf9f4cb4418977962e87352fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:36Z,use_quota=True,user_id='e69e5bdd30474fcca90ca86b64a78b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Creating volume 3035647c-1f60-418c-9619-f7ef9075225f {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3472f4b6-b8b1-4e5f-918b-365eb4277d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:38 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f 1073741824 Sep 01 12:56:38 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de992d6-10c2-4fff-93e6-25c1b1778300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Volume volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b (3ce8e525-3bb1-4677-8bb6-353d98ac724b): created successfully Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de992d6-10c2-4fff-93e6-25c1b1778300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:38 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Flow 'volume_create_manager' (c79f8154-6e43-4341-bff5-dec116b7c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-330c3f17-d2a9-43d4-918e-47ea1642304c tempest-ProjectReaderTests-1017805605 None] Created volume successfully. Sep 01 12:56:38 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:39 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:39 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.373s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-973cd706-e544-4b36-b4d4-b87dd0265779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb589fea-b2f7-4a96-bf38-e70f9ded4d1c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:39 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f 1073741824" returned: 0 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:39 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:39 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:39 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f Sep 01 12:56:39 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:39 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f" returned: 0 in 0.291s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f15e8c-fed6-4930-a6c7-b347fb2966d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3035647c-1f60-418c-9619-f7ef9075225f', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec27cdf-3f59-4ba2-abea-26d3aedae114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Volume volume-3035647c-1f60-418c-9619-f7ef9075225f (3035647c-1f60-418c-9619-f7ef9075225f): created successfully Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec27cdf-3f59-4ba2-abea-26d3aedae114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Flow 'volume_create_manager' (5e306839-deac-47d9-a5e7-0674a4c55f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e06e1e82-832d-4794-8d4f-3d27e49d8293 tempest-CinderUnicodeTest-80043665 None] Created volume successfully. Sep 01 12:56:39 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.595s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:39 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:39 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Acquiring lock "cinder-3ce8e525-3bb1-4677-8bb6-353d98ac724b-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "cinder-3ce8e525-3bb1-4677-8bb6-353d98ac724b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:40 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Acquiring lock "cinder-quobyte-3ce8e525-3bb1-4677-8bb6-353d98ac724b" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.494s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "cinder-quobyte-3ce8e525-3bb1-4677-8bb6-353d98ac724b" acquired by "delete_volume" :: waited 0.044s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:40 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de Sep 01 12:56:40 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beba97b-eb73-4415-981e-45665012ed6b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:40 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b Sep 01 12:56:40 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:40 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Flow 'volume_create_manager' (9d056ea3-337f-4dbd-95f4-03db8b523f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8df241-3b01-49be-a442-e1c7c813bbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779.2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" returned: 0 in 0.388s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8df241-3b01-49be-a442-e1c7c813bbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-590495057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bb760e-287c-48d0-a3db-d255561bd71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf7acf9f4cb4418977962e87352fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:41Z,use_quota=True,user_id='e69e5bdd30474fcca90ca86b64a78b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf704a-1b30-4c40-9642-626c55ca9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf704a-1b30-4c40-9642-626c55ca9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f701a9c-0977-4f22-b085-84bfb7525d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f701a9c-0977-4f22-b085-84bfb7525d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31bb760e-287c-48d0-a3db-d255561bd71e', 'volume_name': 'volume-31bb760e-287c-48d0-a3db-d255561bd71e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f56633-7211-4baa-9371-33e8532a4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f56633-7211-4baa-9371-33e8532a4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03b1db9-a9d4-48b6-8e40-024d98f9b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:40 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Volume 31bb760e-287c-48d0-a3db-d255561bd71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31bb760e-287c-48d0-a3db-d255561bd71e', 'volume_size': 1} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-590495057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bb760e-287c-48d0-a3db-d255561bd71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf7acf9f4cb4418977962e87352fb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:41Z,use_quota=True,user_id='e69e5bdd30474fcca90ca86b64a78b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Creating volume 31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:40 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:40 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e 1073741824 Sep 01 12:56:40 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de" released by "_delete_snapshot" :: held 2.069s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" released by "delete_snapshot" :: held 2.112s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Created reservations ['06386656-67e8-46a4-ab34-199b2b1400ee', 'b0272e3d-1134-451f-8d6f-9219a6d45bb0', 'eee8f140-4641-4111-a86e-24e85040d0fc', '830e940a-7580-484c-8ab7-d9590cbd877e'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:41 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b" returned: 0 in 0.572s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:41 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b Sep 01 12:56:41 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Delete snapshot completed successfully. Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-662c3129-7455-4b07-8b5f-d49c1a85a8ae tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-2bfbbd6d-3d7a-47f7-8d8e-7bc64bf224de-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:41 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3ce8e525-3bb1-4677-8bb6-353d98ac724b" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "cinder-quobyte-3ce8e525-3bb1-4677-8bb6-353d98ac724b" released by "delete_volume" :: held 0.916s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Created reservations ['9c327987-dc7a-47fd-b9af-26374ac3429e', 'f3765b9e-e5ef-47a6-b6f1-d75c0e34109e', '0ad8d0d5-e267-4ea0-92ca-e6c88a36ff1f', 'd203f9bf-ee2f-402f-a083-ed21c315f41b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:41 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e 1073741824" returned: 0 in 0.579s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:41 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e Sep 01 12:56:41 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:41 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:41 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:41 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:41 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.270s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03b1db9-a9d4-48b6-8e40-024d98f9b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bb760e-287c-48d0-a3db-d255561bd71e', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a14a177-61e3-4ee6-80d5-68a31a6e31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Deleted volume successfully. Sep 01 12:56:41 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Volume volume-31bb760e-287c-48d0-a3db-d255561bd71e (31bb760e-287c-48d0-a3db-d255561bd71e): created successfully Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a14a177-61e3-4ee6-80d5-68a31a6e31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Flow 'volume_create_manager' (9d056ea3-337f-4dbd-95f4-03db8b523f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5487dc52-4e39-41a8-9ff4-fc6a0845dc4c tempest-CinderUnicodeTest-80043665 None] Created volume successfully. Sep 01 12:56:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-395b6ffe-ccb9-418c-9965-fb1e429431ee tempest-ProjectReaderTests-1017805605 None] Lock "cinder-3ce8e525-3bb1-4677-8bb6-353d98ac724b-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-973cd706-e544-4b36-b4d4-b87dd0265779-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-973cd706-e544-4b36-b4d4-b87dd0265779-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8df05d4-4a45-46d8-9897-245e30df0b9b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:42 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:42 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:42 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.411s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:42 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779 Sep 01 12:56:42 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:42 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-973cd706-e544-4b36-b4d4-b87dd0265779" returned: 0 in 0.350s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-973cd706-e544-4b36-b4d4-b87dd0265779" released by "delete_volume" :: held 0.842s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Created reservations ['80891940-e0d0-48d5-8472-ad38b4afc314', 'dd4cc62e-e2c9-4821-a6ce-cd775a78d581', 'f0069a60-7b6a-40d8-a9ca-05c01fb825f1', '520e7fd5-f5b1-47d7-8968-e24c001f4dab'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:43 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:43 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Flow 'volume_create_manager' (e87c3a81-4d3e-4c61-89f7-0432bf1c8ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305c5082-2d0e-4c8a-bf87-46b4be3da19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305c5082-2d0e-4c8a-bf87-46b4be3da19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115390067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981dd51e-d1bb-436f-a698-573031fdf08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e732ca75cf5c40be97353c9df68bed55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:43Z,use_quota=True,user_id='404f266a0ab14a10bc29a886f5aa085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076a7a62-765e-4f04-a541-84ba01a5cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076a7a62-765e-4f04-a541-84ba01a5cce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9deadfe3-0ed6-4a15-9715-4489c9712141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9deadfe3-0ed6-4a15-9715-4489c9712141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981dd51e-d1bb-436f-a698-573031fdf08b', 'volume_name': 'volume-981dd51e-d1bb-436f-a698-573031fdf08b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeed550a-04b3-4406-808c-87fc6a209e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeed550a-04b3-4406-808c-87fc6a209e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:43 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccfe688-7c05-492a-a28d-8a31db2e0ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:43 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Volume 981dd51e-d1bb-436f-a698-573031fdf08b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981dd51e-d1bb-436f-a698-573031fdf08b', 'volume_size': 1} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115390067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981dd51e-d1bb-436f-a698-573031fdf08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e732ca75cf5c40be97353c9df68bed55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:43Z,use_quota=True,user_id='404f266a0ab14a10bc29a886f5aa085b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Creating volume 981dd51e-d1bb-436f-a698-573031fdf08b {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:43 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.328s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:43 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b 1073741824 Sep 01 12:56:43 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Deleted volume successfully. Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bc28a8e7-6f14-4df0-9f0a-8285a13da9a2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-973cd706-e544-4b36-b4d4-b87dd0265779-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bc6e3-2659-438c-a449-1e2b6ff4297c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:43 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c Sep 01 12:56:43 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" returned: 0 in 0.412s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:44 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b 1073741824" returned: 0 in 0.531s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c Sep 01 12:56:44 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:44 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b Sep 01 12:56:44 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" returned: 0 in 0.308s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-quobyte-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c" released by "delete_volume" :: held 0.771s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.808s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Creating offline snapshot 12b34882-0ec5-4618-97cc-855123982350 of volume 31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cccfe688-7c05-492a-a28d-8a31db2e0ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981dd51e-d1bb-436f-a698-573031fdf08b', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f6b6f2-2113-458e-99bf-cbb7aed69225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0630e-7093-40b3-bb83-081ebe23583b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:44 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Volume volume-981dd51e-d1bb-436f-a698-573031fdf08b (981dd51e-d1bb-436f-a698-573031fdf08b): created successfully Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f6b6f2-2113-458e-99bf-cbb7aed69225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Flow 'volume_create_manager' (e87c3a81-4d3e-4c61-89f7-0432bf1c8ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-75184548-c015-4c04-a0c2-c06bb13e40eb tempest-ProjectReaderTests-1017805605 None] Created volume successfully. Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Created reservations ['d5cf1db0-ffd6-4ba4-9d91-5f78424bfb24', '789c36ea-001f-4308-8f9e-c99194f5418d', 'e2a2824d-8255-4437-855b-569dddba6fd6', '33a05bb4-7f7b-48d9-bde0-5b01d50e5c32'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:44 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e Sep 01 12:56:44 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:44 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:44 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.288s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:44 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 1G Sep 01 12:56:44 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Deleted volume successfully. Sep 01 12:56:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a0a3faed-96a3-4ea6-8f69-b74bd6dce5b2 tempest-VolumeDependencyTests-1747773208 None] Lock "cinder-25c4c20d-8c42-48b1-9e5f-3aeab2d38c1c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Acquiring lock "cinder-981dd51e-d1bb-436f-a698-573031fdf08b-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "cinder-981dd51e-d1bb-436f-a698-573031fdf08b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Acquiring lock "cinder-quobyte-981dd51e-d1bb-436f-a698-573031fdf08b" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "cinder-quobyte-981dd51e-d1bb-436f-a698-573031fdf08b" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:45 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 1G" returned: 0 in 0.606s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31bb760e-287c-48d0-a3db-d255561bd71e -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[df889f55-ece4-4354-a742-fb98a83720ef]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:45 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31bb760e-287c-48d0-a3db-d255561bd71e -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 Sep 01 12:56:45 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:45 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b Sep 01 12:56:45 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:45 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31bb760e-287c-48d0-a3db-d255561bd71e -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350" returned: 0 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:45 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 is being set with open permissions: ugo+rw Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:45 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 Sep 01 12:56:45 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:45 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b" returned: 0 in 0.496s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:46 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b Sep 01 12:56:46 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:46 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350" returned: 0 in 0.302s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:46 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info Sep 01 12:56:46 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:46 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-981dd51e-d1bb-436f-a698-573031fdf08b" returned: 0 in 0.336s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "cinder-quobyte-981dd51e-d1bb-436f-a698-573031fdf08b" released by "delete_volume" :: held 0.890s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Created reservations ['4cfb17f7-c659-493b-aab8-ca10499028cc', '6018ad20-6107-42c2-9b4c-59d0b27d3cc4', '03384fd8-9b42-4b4a-9e62-013575a20223', 'a479e445-c90c-4f5b-a8ae-6aee02918ec9'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:46 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:46 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:46 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info" returned: 0 in 0.401s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info is being set with open permissions: ugo+rw Sep 01 12:56:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:46 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info Sep 01 12:56:46 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:47 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.581s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Deleted volume successfully. Sep 01 12:56:47 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.info" returned: 0 in 0.491s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-bd7c22c4-6e80-4a42-a5da-7352da418712 tempest-ProjectReaderTests-1017805605 None] Lock "cinder-981dd51e-d1bb-436f-a698-573031fdf08b-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-de40aea7-337d-41c7-b46c-75cf26417f2c tempest-CinderUnicodeTest-80043665 None] Create snapshot completed successfully Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-12b34882-0ec5-4618-97cc-855123982350-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-12b34882-0ec5-4618-97cc-855123982350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-quobyte-12b34882-0ec5-4618-97cc-855123982350" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-12b34882-0ec5-4618-97cc-855123982350" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Deleting offline snapshot 12b34882-0ec5-4618-97cc-855123982350 of volume 31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] snapshot_file for this snap is: volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d183ed3-29e4-4ae4-9834-0a3d3823566b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:47 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 Sep 01 12:56:47 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:48 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350" returned: 0 in 0.542s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31bb760e-287c-48d0-a3db-d255561bd71e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:56:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e2e0d7-3d1c-4145-b8c0-1bf5f696d269]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:48 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e Sep 01 12:56:48 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:49 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e" returned: 0 in 0.711s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:49 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 Sep 01 12:56:49 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:49 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350" returned: 0 in 0.504s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:49 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350 Sep 01 12:56:49 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:49 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e.12b34882-0ec5-4618-97cc-855123982350" returned: 0 in 0.335s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-12b34882-0ec5-4618-97cc-855123982350" released by "_delete_snapshot" :: held 2.246s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" released by "delete_snapshot" :: held 2.291s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Created reservations ['bda9058d-9f66-47f2-9d58-47837097ad05', '340fc8fe-a999-478f-9d59-7e6663fb960f', 'ed91bd7d-acb8-45ad-a4c6-adf36cc8d743', '11a2eaf3-4411-409f-a23a-1671808f8034'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Delete snapshot completed successfully. Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1e4564be-8715-4656-8967-a8798e018bbc tempest-CinderUnicodeTest-80043665 None] Lock "cinder-12b34882-0ec5-4618-97cc-855123982350-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-31bb760e-287c-48d0-a3db-d255561bd71e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "cinder-31bb760e-287c-48d0-a3db-d255561bd71e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=279,cinder:SELECT=211,cinder:DELETE=26,cinder:INSERT=75 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b223c3c3-1e76-455e-9acf-36c35e1dafb8]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:51 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e Sep 01 12:56:51 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:51 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e" returned: 0 in 0.414s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:51 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e Sep 01 12:56:51 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:51 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-31bb760e-287c-48d0-a3db-d255561bd71e" returned: 0 in 0.315s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-31bb760e-287c-48d0-a3db-d255561bd71e" released by "delete_volume" :: held 0.824s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=203,cinder:UPDATE=289,cinder:INSERT=76,cinder:DELETE=25 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Created reservations ['80e8246a-d6b9-483c-a94a-99669b331526', '27eb9a9b-5531-4ca1-a4ff-9b294f9094ca', 'e7a127c0-f7bd-4628-bf77-d93ca0e99e2c', '3492b2b0-a217-49ba-ba2b-bfc749682f78'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:52 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:52 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-3035647c-1f60-418c-9619-f7ef9075225f-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "cinder-3035647c-1f60-418c-9619-f7ef9075225f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Acquiring lock "cinder-quobyte-3035647c-1f60-418c-9619-f7ef9075225f" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-3035647c-1f60-418c-9619-f7ef9075225f" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8e314-d14f-4774-b4cc-614bec248591]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:52 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.419s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:52 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f Sep 01 12:56:52 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Deleted volume successfully. Sep 01 12:56:52 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-badc68ad-c869-416b-bc33-311fdecc8363 tempest-CinderUnicodeTest-80043665 None] Lock "cinder-31bb760e-287c-48d0-a3db-d255561bd71e-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:52 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f" returned: 0 in 0.514s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:52 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f Sep 01 12:56:52 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:53 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-3035647c-1f60-418c-9619-f7ef9075225f" returned: 0 in 0.353s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "cinder-quobyte-3035647c-1f60-418c-9619-f7ef9075225f" released by "delete_volume" :: held 0.929s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Created reservations ['48cd76c0-78b9-409e-87cb-b9f7b8f216c2', '345ceb22-1888-46ab-850b-a95e529625b3', '05ad7e76-1a73-45e9-a138-853a5dc9acd9', '96e3041c-50f7-4d82-af5b-3ee83a29b5dc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:53 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:56:53 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:53 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.312s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:56:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Deleted volume successfully. Sep 01 12:56:53 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f4c08e07-b032-47c8-b63e-f4ae4074520a tempest-CinderUnicodeTest-80043665 None] Lock "cinder-3035647c-1f60-418c-9619-f7ef9075225f-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (d3819062-7d71-4fad-8d1a-e37cd1e9abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd39485d-4608-4305-a128-612d1343f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd39485d-4608-4305-a128-612d1343f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844093172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebe8c39-eb63-49c6-8f44-4ad85a348467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:57Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b994ad-e865-4989-86a3-9ed44bf5c773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b994ad-e865-4989-86a3-9ed44bf5c773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccbd8a-1c00-491d-babf-ca8c9145bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fccbd8a-1c00-491d-babf-ca8c9145bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ebe8c39-eb63-49c6-8f44-4ad85a348467', 'volume_name': 'volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d0f299-b24c-4e93-93d9-712fb2a34e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d0f299-b24c-4e93-93d9-712fb2a34e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa50f8-bfe7-4f9f-9918-07ea61fa22f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Volume 0ebe8c39-eb63-49c6-8f44-4ad85a348467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467', 'volume_size': 1} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844093172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ebe8c39-eb63-49c6-8f44-4ad85a348467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:56:57Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Creating volume 0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:56:57 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:56:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:57 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 1073741824 Sep 01 12:56:57 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:58 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 1073741824" returned: 0 in 0.575s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:56:58 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 Sep 01 12:56:58 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:56:58 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa50f8-bfe7-4f9f-9918-07ea61fa22f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63b6074-07ed-4f46-9ca1-25ba6939785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:56:58 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Volume volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 (0ebe8c39-eb63-49c6-8f44-4ad85a348467): created successfully Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63b6074-07ed-4f46-9ca1-25ba6939785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (d3819062-7d71-4fad-8d1a-e37cd1e9abcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:56:58 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b3d0a77e-fee5-4eb0-91b7-2d546578cf74 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:56:58 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-c3035d69-5eab-41d5-b68a-83998a3f2931 tempest-ProjectAdminTests-1172289992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9766807556152, 'free_capacity_gb': 1773.9766807556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87008) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 498fb66f-5092-477c-89b2-dc725f6ed677 of volume 0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8532780-1d60-43a7-8de0-573a44ed4ceb]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:00 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 Sep 01 12:57:00 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:00 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467" returned: 0 in 0.442s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:00 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 1G Sep 01 12:57:00 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:01 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 1G" returned: 0 in 0.598s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:01 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 Sep 01 12:57:01 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:01 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677" returned: 0 in 0.324s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:01 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 is being set with open permissions: ugo+rw Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:01 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 Sep 01 12:57:01 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:01 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:01 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info Sep 01 12:57:01 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:02 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info" returned: 0 in 0.435s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:02 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info is being set with open permissions: ugo+rw Sep 01 12:57:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:02 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info Sep 01 12:57:02 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:02 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.info" returned: 0 in 0.327s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-bb6efb94-235a-4f8f-9e4d-a2ab63c68200 tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-498fb66f-5092-477c-89b2-dc725f6ed677-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-498fb66f-5092-477c-89b2-dc725f6ed677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-498fb66f-5092-477c-89b2-dc725f6ed677" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-498fb66f-5092-477c-89b2-dc725f6ed677" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 498fb66f-5092-477c-89b2-dc725f6ed677 of volume 0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23a626-8976-4cce-b77c-40d821db5634]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:03 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 Sep 01 12:57:03 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:03 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677" returned: 0 in 0.452s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[641e61e1-97e7-4d5d-b55e-8845c0f531de]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:03 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 Sep 01 12:57:03 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:04 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467" returned: 0 in 0.425s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:04 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 Sep 01 12:57:04 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:04 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677" returned: 0 in 0.526s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:04 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677 Sep 01 12:57:04 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:05 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467.498fb66f-5092-477c-89b2-dc725f6ed677" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-498fb66f-5092-477c-89b2-dc725f6ed677" released by "_delete_snapshot" :: held 1.877s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" released by "delete_snapshot" :: held 1.912s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Created reservations ['e454e7ce-d319-4b01-ad58-f93427b33563', 'f119dc82-d85a-40d5-8572-58e810517264', 'bcd547b8-1aec-40ca-97d3-6ef6bbf1efb0', 'bfff2ab5-3068-48b5-979c-56b15c476fa4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-650e3a05-a47d-4c9b-a31d-947e8dceaba8 tempest-ProjectMemberTests-643974733 None] Lock "cinder-498fb66f-5092-477c-89b2-dc725f6ed677-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-0ebe8c39-eb63-49c6-8f44-4ad85a348467-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "cinder-0ebe8c39-eb63-49c6-8f44-4ad85a348467-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87f0a8-ef36-48ce-b745-ca3e74504c25]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:05 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 Sep 01 12:57:05 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:06 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467" returned: 0 in 0.431s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:06 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467 Sep 01 12:57:06 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:06 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-0ebe8c39-eb63-49c6-8f44-4ad85a348467" returned: 0 in 0.323s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-0ebe8c39-eb63-49c6-8f44-4ad85a348467" released by "delete_volume" :: held 0.853s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Created reservations ['b286812b-740d-436d-a2c2-4b8c38ade926', '85945c33-44e3-46ac-8243-6175a9474ed0', 'caa6b6ec-d4fd-4f1c-9d72-6501ccd77a61', 'c00c9a6c-3129-4cdc-9a42-e715ae42fbee'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:06 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:06 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:06 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.367s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:06 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:57:06 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-3e5c1995-509e-45dd-b44a-5bfd0ff2ceab tempest-ProjectMemberTests-643974733 None] Lock "cinder-0ebe8c39-eb63-49c6-8f44-4ad85a348467-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (8df0877d-ccad-467c-9517-38b3d42c2a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b7fd46-02ee-4ce3-b1a0-c5dedd870cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b7fd46-02ee-4ce3-b1a0-c5dedd870cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623473329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9860b-b4a1-4937-b491-4d2cd2ece680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:07Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a073f-1499-4461-a559-b593c2a4a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a073f-1499-4461-a559-b593c2a4a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cad428a-4b8a-4e3d-8de8-33772fecd667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cad428a-4b8a-4e3d-8de8-33772fecd667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e9860b-b4a1-4937-b491-4d2cd2ece680', 'volume_name': 'volume-61e9860b-b4a1-4937-b491-4d2cd2ece680', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56aad21-788f-41fc-8b0e-6ac2ba4f5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56aad21-788f-41fc-8b0e-6ac2ba4f5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb619a1-d934-4a1b-a482-33b821207621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:07 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Volume 61e9860b-b4a1-4937-b491-4d2cd2ece680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e9860b-b4a1-4937-b491-4d2cd2ece680', 'volume_size': 1} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1623473329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9860b-b4a1-4937-b491-4d2cd2ece680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:07Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Creating volume 61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:07 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:07 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 1073741824 Sep 01 12:57:07 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:08 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 1073741824" returned: 0 in 0.813s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:08 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 Sep 01 12:57:08 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:08 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680" returned: 0 in 0.318s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb619a1-d934-4a1b-a482-33b821207621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e9860b-b4a1-4937-b491-4d2cd2ece680', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8a6b59-a496-47dd-a2f0-e13c990a85c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:08 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Volume volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 (61e9860b-b4a1-4937-b491-4d2cd2ece680): created successfully Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8a6b59-a496-47dd-a2f0-e13c990a85c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (8df0877d-ccad-467c-9517-38b3d42c2a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:08 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-cd621403-79fb-4920-b36a-d8a28e1967b0 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (8dd35159-96cf-4f66-b268-b754200eda1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb03ba-9ec8-4081-b8de-5a87fa7ab091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb03ba-9ec8-4081-b8de-5a87fa7ab091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067688022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:09Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24430ce1-8ad0-44c5-b750-604a9b90f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24430ce1-8ad0-44c5-b750-604a9b90f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b3a46c-bda6-488d-87ae-afab82603aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b3a46c-bda6-488d-87ae-afab82603aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d', 'volume_name': 'volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130f60f-0b78-4f97-8b47-9816c1d2783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130f60f-0b78-4f97-8b47-9816c1d2783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ed582a-a0a0-4dae-9cb2-f8b0e72f4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Volume aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d', 'volume_size': 1} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067688022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:09Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Creating volume aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:09 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:09 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d 1073741824 Sep 01 12:57:09 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:09 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d 1073741824" returned: 0 in 0.526s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:09 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d Sep 01 12:57:09 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:10 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.445s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ed582a-a0a0-4dae-9cb2-f8b0e72f4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e7c170-e851-4a84-b3b5-b7f1c18ea729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 3187e913-cdf5-48c2-b4d7-324d24d5d064 of volume 61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Volume volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d (aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d): created successfully Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e7c170-e851-4a84-b3b5-b7f1c18ea729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (8dd35159-96cf-4f66-b268-b754200eda1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d47f8-257b-41e7-95a6-baa13ffbf40b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6f5b0fb0-8b1e-46b5-8daf-391d924f4dd1 tempest-ProjectReaderTests-1866619289 None] Created volume successfully. Sep 01 12:57:10 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 Sep 01 12:57:10 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:10 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680" returned: 0 in 0.427s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:10 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 1G Sep 01 12:57:10 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:11 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 1G" returned: 0 in 0.438s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:11 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 Sep 01 12:57:11 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:11 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064" returned: 0 in 0.355s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:11 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 is being set with open permissions: ugo+rw Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:11 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 Sep 01 12:57:11 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:11 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064" returned: 0 in 0.312s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:11 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info Sep 01 12:57:11 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:12 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info" returned: 0 in 0.275s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:12 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info is being set with open permissions: ugo+rw Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:12 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info Sep 01 12:57:12 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:12 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.info" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.804s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Creating offline snapshot 922a7def-98fa-4d70-a9b7-31e07a2f1c44 of volume aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b684ccbd-3a45-4c77-827d-cb604c8f7a40 tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[60764eff-ece5-4f27-9156-2b662cfa1a30]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:12 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d Sep 01 12:57:12 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:12 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" returned: 0 in 0.417s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:12 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 1G Sep 01 12:57:12 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-3187e913-cdf5-48c2-b4d7-324d24d5d064-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3187e913-cdf5-48c2-b4d7-324d24d5d064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-3187e913-cdf5-48c2-b4d7-324d24d5d064" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3187e913-cdf5-48c2-b4d7-324d24d5d064" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 3187e913-cdf5-48c2-b4d7-324d24d5d064 of volume 61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8f93a-3ec6-43ca-a66c-6c3b9cf2adf5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:13 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 Sep 01 12:57:13 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:13 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 1G" returned: 0 in 0.573s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:13 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 Sep 01 12:57:13 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:13 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064" returned: 0 in 0.460s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e9860b-b4a1-4937-b491-4d2cd2ece680(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[924cf052-9d00-459d-9796-7cb1b505ffaa]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:13 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 Sep 01 12:57:13 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:13 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44" returned: 0 in 0.374s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:13 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 is being set with open permissions: ugo+rw Sep 01 12:57:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:13 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 Sep 01 12:57:13 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:13 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:14 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 Sep 01 12:57:14 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:14 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:14 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info Sep 01 12:57:14 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:14 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064" returned: 0 in 0.527s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:14 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info is being set with open permissions: ugo+rw Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:14 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064 Sep 01 12:57:14 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:14 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info Sep 01 12:57:14 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:14 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680.3187e913-cdf5-48c2-b4d7-324d24d5d064" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3187e913-cdf5-48c2-b4d7-324d24d5d064" released by "_delete_snapshot" :: held 1.931s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.info" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" released by "delete_snapshot" :: held 1.978s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-28332d93-86b7-4217-b478-2b239ca02e5c tempest-ProjectReaderTests-1866619289 None] Create snapshot completed successfully Sep 01 12:57:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Created reservations ['769a28b2-0b37-4809-9e25-f8136227e590', 'b60906c1-2850-464d-bd14-6c784d3e0cdc', '5a6baf23-a47a-4eeb-b4d4-e6a40657af1f', '1ce6c873-ee73-405e-adfe-a6d271c0604f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:15 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-f8912a2f-d2a4-4b4f-b0ce-5adad87a90c4 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3187e913-cdf5-48c2-b4d7-324d24d5d064-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-922a7def-98fa-4d70-a9b7-31e07a2f1c44-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-922a7def-98fa-4d70-a9b7-31e07a2f1c44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-922a7def-98fa-4d70-a9b7-31e07a2f1c44" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-922a7def-98fa-4d70-a9b7-31e07a2f1c44" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Deleting offline snapshot 922a7def-98fa-4d70-a9b7-31e07a2f1c44 of volume aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] snapshot_file for this snap is: volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2ac94-6fda-4dca-8372-7faaad1edc66]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-61e9860b-b4a1-4937-b491-4d2cd2ece680-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "cinder-61e9860b-b4a1-4937-b491-4d2cd2ece680-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:16 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 Sep 01 12:57:16 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75fffe-bd6f-4f38-9403-18b8e5d76645]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:16 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 Sep 01 12:57:16 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44" returned: 0 in 0.410s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8b506-405a-4502-9bfb-06fcbee3792c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:16 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d Sep 01 12:57:16 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:16 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680" returned: 0 in 0.464s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:16 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680 Sep 01 12:57:16 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:17 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" returned: 0 in 0.448s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:17 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 Sep 01 12:57:17 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:17 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-61e9860b-b4a1-4937-b491-4d2cd2ece680" returned: 0 in 0.352s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-61e9860b-b4a1-4937-b491-4d2cd2ece680" released by "delete_volume" :: held 0.901s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Created reservations ['fe525286-61cf-4901-8442-2c90433f6501', '54eba770-03b7-4db9-86aa-0b744e1413de', 'a6fd374d-a069-4006-a9bb-160621274561', '14a74bce-6c88-4ef5-b0bb-dde865f248a2'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:17 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:17 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:17 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44" returned: 0 in 0.543s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:17 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44 Sep 01 12:57:17 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:17 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.322s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:57:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9068b4b1-fe1f-4f4e-a821-55db4fc0b708 tempest-ProjectMemberTests-643974733 None] Lock "cinder-61e9860b-b4a1-4937-b491-4d2cd2ece680-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:18 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d.922a7def-98fa-4d70-a9b7-31e07a2f1c44" returned: 0 in 0.363s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-922a7def-98fa-4d70-a9b7-31e07a2f1c44" released by "_delete_snapshot" :: held 1.890s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" released by "delete_snapshot" :: held 1.921s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Created reservations ['30335db9-5f90-413f-ba60-9f5d3085ab3e', 'db9fb2ef-ce91-493b-b926-25e9bcce7c35', '1cd3c448-5e1f-440f-9a60-c2c87d961eef', '7fae48fe-5520-4ff7-ab5d-41d87ec7a8f6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (c7663172-33ec-4a4d-98ca-9e858f396bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f072c237-b0db-4e6c-85bb-bd03f3723b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f072c237-b0db-4e6c-85bb-bd03f3723b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686717333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:18Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9cfdd5-6b77-4cb7-94ea-1973fbdb82e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9cfdd5-6b77-4cb7-94ea-1973fbdb82e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34d3bff-d46f-4b60-89dc-7955493e541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34d3bff-d46f-4b60-89dc-7955493e541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99', 'volume_name': 'volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e009b171-a6c3-4e59-9c57-4a37def5e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e009b171-a6c3-4e59-9c57-4a37def5e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5561ef56-d4ea-4ff9-bbf5-805cb133b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Volume 2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99', 'volume_size': 1} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1686717333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:18Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Creating volume 2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:18 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:18 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 1073741824 Sep 01 12:57:18 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Delete snapshot completed successfully. Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-246d4102-c241-4df9-8948-6a53d8708606 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-922a7def-98fa-4d70-a9b7-31e07a2f1c44-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:18 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 1073741824" returned: 0 in 0.490s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:18 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 Sep 01 12:57:18 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:19 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5561ef56-d4ea-4ff9-bbf5-805cb133b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666203-0823-461b-afa1-bfb63cd9532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:19 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Volume volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 (2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99): created successfully Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666203-0823-461b-afa1-bfb63cd9532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (c7663172-33ec-4a4d-98ca-9e858f396bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-184343b0-a80b-4afc-9247-ecf5ec2aa04e tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "cinder-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf78d63-db6c-4ba9-aa3b-fd9ca0636bcc]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:19 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d Sep 01 12:57:19 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:19 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" returned: 0 in 0.411s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:19 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d Sep 01 12:57:19 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:20 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d" released by "delete_volume" :: held 0.764s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Created reservations ['c52e3d32-a9a5-4e16-8661-ce6f6357e312', '84b71643-efc9-4581-84df-5e1b4eb1bbd2', 'fbb0e3bf-86b8-42c2-b016-97427a071599', 'e24cdca1-1c08-41b0-b77b-09b05d06e93c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:20 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:20 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 6735fc46-f0a4-4ba9-ab09-7ff7373cac88 of volume 2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbd35d-6c7f-4c12-9cc9-9636ebd8b8a6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:20 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.390s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Deleted volume successfully. Sep 01 12:57:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-77ee1317-64c2-4ee6-9f19-b6ccdcb5c54c tempest-ProjectReaderTests-1866619289 None] Lock "cinder-aad56b7c-50a6-44d0-88a1-83fd0f9d6c1d-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:20 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 Sep 01 12:57:20 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:21 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" returned: 0 in 0.561s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:21 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 1G Sep 01 12:57:21 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (b2507fc1-cca7-43ed-b7c2-20d2b0b8a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549f9589-dcbf-4d49-8421-37702c2412bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549f9589-dcbf-4d49-8421-37702c2412bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48282d8a-855d-427e-ad3b-563506166c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:21Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd74c6cd-73d5-4473-bf67-6d83d7e6c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd74c6cd-73d5-4473-bf67-6d83d7e6c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b0c8d8-e702-4ce7-8f12-296085be0120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b0c8d8-e702-4ce7-8f12-296085be0120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48282d8a-855d-427e-ad3b-563506166c6d', 'volume_name': 'volume-48282d8a-855d-427e-ad3b-563506166c6d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c218d6c-5612-4e9e-9ed3-ea5dba392aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c218d6c-5612-4e9e-9ed3-ea5dba392aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269e5dce-be50-4e9e-954a-f40d364e2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Volume 48282d8a-855d-427e-ad3b-563506166c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48282d8a-855d-427e-ad3b-563506166c6d', 'volume_size': 1} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:21 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 1G" returned: 0 in 0.482s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:21 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 Sep 01 12:57:21 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:21 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Flow 'volume_create_manager' (6c8a801a-2815-4074-b653-e83548a65c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc249bb6-8f3f-4b06-b65e-3e7be6484535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc249bb6-8f3f-4b06-b65e-3e7be6484535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1843228112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eb8767-e8d2-4d70-a927-0c5044b575e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2302686fe065413d8319b590404c5637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:22Z,use_quota=True,user_id='0394f00c989b4f2da113ceb4b3c47c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feeabbd-0ace-4e1d-946d-4e77a0375898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:22 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feeabbd-0ace-4e1d-946d-4e77a0375898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09782d45-09fa-488c-ab5b-99dc6d2da635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09782d45-09fa-488c-ab5b-99dc6d2da635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5eb8767-e8d2-4d70-a927-0c5044b575e9', 'volume_name': 'volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9d2f4b-e3b3-425f-99cb-02782ac0ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9d2f4b-e3b3-425f-99cb-02782ac0ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43746f97-070b-4248-ad57-15c28c578dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:22 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Volume d5eb8767-e8d2-4d70-a927-0c5044b575e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9', 'volume_size': 1} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 is being set with open permissions: ugo+rw Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:22 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 Sep 01 12:57:22 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:22 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:22 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info Sep 01 12:57:22 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:22 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info is being set with open permissions: ugo+rw Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:22 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info Sep 01 12:57:22 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:22 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.info" returned: 0 in 0.251s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48282d8a-855d-427e-ad3b-563506166c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:21Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Creating volume 48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:22 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:22 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d 1073741824 Sep 01 12:57:22 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:22 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b7c6dfb2-43c9-4df0-8f21-f0379b5372d6 tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:23 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d 1073741824" returned: 0 in 0.435s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:23 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d Sep 01 12:57:23 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:23 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1843228112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eb8767-e8d2-4d70-a927-0c5044b575e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2302686fe065413d8319b590404c5637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:22Z,use_quota=True,user_id='0394f00c989b4f2da113ceb4b3c47c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Creating volume d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:23 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269e5dce-be50-4e9e-954a-f40d364e2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48282d8a-855d-427e-ad3b-563506166c6d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:23 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 1073741824 Sep 01 12:57:23 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b6ecf-8e5e-4801-8968-defbeae8d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:23 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Volume volume-48282d8a-855d-427e-ad3b-563506166c6d (48282d8a-855d-427e-ad3b-563506166c6d): created successfully Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b6ecf-8e5e-4801-8968-defbeae8d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (b2507fc1-cca7-43ed-b7c2-20d2b0b8a135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-6735fc46-f0a4-4ba9-ab09-7ff7373cac88-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-85c61892-3126-40a1-b7c0-b38124e33875 tempest-ProjectReaderTests-1866619289 None] Created volume successfully. Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-6735fc46-f0a4-4ba9-ab09-7ff7373cac88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-6735fc46-f0a4-4ba9-ab09-7ff7373cac88" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-6735fc46-f0a4-4ba9-ab09-7ff7373cac88" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 6735fc46-f0a4-4ba9-ab09-7ff7373cac88 of volume 2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed1c27f-df01-4149-937e-1b5e3123cd17]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:23 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 Sep 01 12:57:23 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:24 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 1073741824" returned: 0 in 0.483s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:24 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:24 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:24 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88" returned: 0 in 0.416s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0621cc43-98c0-48a1-9408-ee3613e4bb3a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:24 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 Sep 01 12:57:24 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:24 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.365s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43746f97-070b-4248-ad57-15c28c578dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a178b3-9761-40c0-ba15-bd2665510343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:24 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Volume volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 (d5eb8767-e8d2-4d70-a927-0c5044b575e9): created successfully Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a178b3-9761-40c0-ba15-bd2665510343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Flow 'volume_create_manager' (6c8a801a-2815-4074-b653-e83548a65c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:24 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-aab6ee3d-71ba-4f88-a058-ed7787db093a tempest-SnapshotDependencyTests-754834849 None] Created volume successfully. Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Creating offline snapshot ec3f5436-aef9-4f3b-a292-2c4b692eb428 of volume 48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32e58a3-7f6b-41fa-af06-238e2ae98b0a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:24 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" returned: 0 in 0.437s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:24 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 Sep 01 12:57:24 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:24 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d Sep 01 12:57:24 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:25 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88" returned: 0 in 0.342s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:25 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:25 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88 Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d" returned: 0 in 0.460s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:25 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:25 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 1G Sep 01 12:57:25 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:25 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99.6735fc46-f0a4-4ba9-ab09-7ff7373cac88" returned: 0 in 0.304s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-6735fc46-f0a4-4ba9-ab09-7ff7373cac88" released by "_delete_snapshot" :: held 1.625s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" released by "delete_snapshot" :: held 1.657s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Created reservations ['ac9bd740-57f6-4da9-86bb-b69e2e67928e', 'aaf1f12d-dbcc-4186-9d97-6babc462103d', '519ddc33-296a-44a4-a0c9-d0b0d4174c4e', '706ef4a6-7880-4632-828a-b0048cbf1a3f'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:25 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ccea8d72-1fd2-4277-ad6a-c14d995b6253 tempest-ProjectMemberTests-643974733 None] Lock "cinder-6735fc46-f0a4-4ba9-ab09-7ff7373cac88-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:25 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 1G" returned: 0 in 0.587s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48282d8a-855d-427e-ad3b-563506166c6d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:25 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48282d8a-855d-427e-ad3b-563506166c6d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 Sep 01 12:57:25 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "cinder-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e1479-7446-42d7-966a-da374b9ef7d6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48282d8a-855d-427e-ad3b-563506166c6d -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428" returned: 0 in 0.348s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 is being set with open permissions: ugo+rw Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 Sep 01 12:57:26 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 Sep 01 12:57:26 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info Sep 01 12:57:26 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99 Sep 01 12:57:26 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info is being set with open permissions: ugo+rw Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info Sep 01 12:57:26 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:26 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" returned: 0 in 0.275s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99" released by "delete_volume" :: held 0.718s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Created reservations ['5f6a7ba8-1f7d-43bc-a999-93302f1ba7f9', 'e1aba57f-8d61-4b76-bb42-8d2e2db43e70', '6c51133d-ae1d-48d8-9fda-38e6c674a5ab', '768fc0c7-3a6e-4f5c-aa22-c1bbe24c39a4'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:26 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:26 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:26 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.info" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.412s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.306s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:57:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Creating offline snapshot 84d234cc-b2df-47e9-9e8f-4f04a536e85e of volume d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-28134c53-b812-4691-8ad6-569692f840a9 tempest-ProjectReaderTests-1866619289 None] Create snapshot completed successfully Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c3239-f3d2-403d-aa71-af3d832cc7e1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:27 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:27 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:27 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.311s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-b8e3030e-eb7b-467c-bac8-674d6939aa96 tempest-ProjectMemberTests-643974733 None] Lock "cinder-2e53eaa7-c1d4-4cba-bc0c-7437d1bebf99-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:27 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.420s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:27 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e 1G Sep 01 12:57:27 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (9e7d96a0-e7b6-4013-813a-83ecf9c5a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f380366-6e4e-4944-af21-a339bd4c0952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f380366-6e4e-4944-af21-a339bd4c0952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270135001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da50b9b9-8626-416f-9d08-09d92b41b8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:28Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d9013c-3ec3-4a21-b8ed-9fa4588d07f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d9013c-3ec3-4a21-b8ed-9fa4588d07f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b97dec-056c-4fae-9023-7c9e9020f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b97dec-056c-4fae-9023-7c9e9020f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da50b9b9-8626-416f-9d08-09d92b41b8de', 'volume_name': 'volume-da50b9b9-8626-416f-9d08-09d92b41b8de', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ef0401-50b2-4bbe-bfef-cb9a1a9862da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ef0401-50b2-4bbe-bfef-cb9a1a9862da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83488e29-e076-45c1-9a1e-e7acabbe9c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:27 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Volume da50b9b9-8626-416f-9d08-09d92b41b8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da50b9b9-8626-416f-9d08-09d92b41b8de', 'volume_size': 1} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-ec3f5436-aef9-4f3b-a292-2c4b692eb428-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-ec3f5436-aef9-4f3b-a292-2c4b692eb428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-ec3f5436-aef9-4f3b-a292-2c4b692eb428" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-ec3f5436-aef9-4f3b-a292-2c4b692eb428" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Deleting offline snapshot ec3f5436-aef9-4f3b-a292-2c4b692eb428 of volume 48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] snapshot_file for this snap is: volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e163f8-f6f2-4d41-9eb2-0e1051da0758]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:27 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e 1G" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:27 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:27 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:27 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 Sep 01 12:57:27 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:28 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428" returned: 0 in 0.368s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48282d8a-855d-427e-ad3b-563506166c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:28 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.321s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:28 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e is being set with open permissions: ugo+rw Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a368a-f095-4b16-b7ac-a1807edd4af2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:28 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:28 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:28 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d Sep 01 12:57:28 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:28 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.254s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:28 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info Sep 01 12:57:28 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:28 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d" returned: 0 in 0.391s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:28 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 Sep 01 12:57:28 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:28 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:28 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info is being set with open permissions: ugo+rw Sep 01 12:57:28 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:28 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info Sep 01 12:57:28 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:29 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:29 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428 Sep 01 12:57:29 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:29 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.info" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270135001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da50b9b9-8626-416f-9d08-09d92b41b8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:28Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Creating volume da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:29 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:29 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de 1073741824 Sep 01 12:57:29 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-48d0f64a-bb84-4459-88c2-633c569abb88 tempest-SnapshotDependencyTests-754834849 None] Create snapshot completed successfully Sep 01 12:57:29 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d.ec3f5436-aef9-4f3b-a292-2c4b692eb428" returned: 0 in 0.271s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-ec3f5436-aef9-4f3b-a292-2c4b692eb428" released by "_delete_snapshot" :: held 1.507s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" released by "delete_snapshot" :: held 1.530s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Created reservations ['feb5cf6e-1bbb-4710-ac7d-d435851dab5b', '1ee28825-1587-40c4-80e4-5d063ec6e722', '8078dee7-c2d6-489f-8201-ac44c9422ff3', '6fc076f8-e5b9-49aa-b350-1de7c163c6c6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:29 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Delete snapshot completed successfully. Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-009b7339-ecc1-448a-9913-8cd0c4604825 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-ec3f5436-aef9-4f3b-a292-2c4b692eb428-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:29 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de 1073741824" returned: 0 in 0.453s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:29 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de Sep 01 12:57:29 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:29 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de" returned: 0 in 0.293s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83488e29-e076-45c1-9a1e-e7acabbe9c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da50b9b9-8626-416f-9d08-09d92b41b8de', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccb0429-5280-4fbb-bff8-54b25123de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-48282d8a-855d-427e-ad3b-563506166c6d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:29 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Volume volume-da50b9b9-8626-416f-9d08-09d92b41b8de (da50b9b9-8626-416f-9d08-09d92b41b8de): created successfully Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccb0429-5280-4fbb-bff8-54b25123de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (9e7d96a0-e7b6-4013-813a-83ecf9c5a58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:29 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-48282d8a-855d-427e-ad3b-563506166c6d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:30 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-55fe8dbf-c5fd-4ccf-ab52-b7cf68114388 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a424cd-ee09-42b9-b110-568a245e4a7b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:30 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d Sep 01 12:57:30 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Flow 'volume_create_manager' (caa5a6a9-e569-4224-96e4-4ca3db63dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca008a60-1f28-46c8-8cf3-1fa7d96cc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca008a60-1f28-46c8-8cf3-1fa7d96cc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2302686fe065413d8319b590404c5637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84d234cc-b2df-47e9-9e8f-4f04a536e85e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:30Z,use_quota=True,user_id='0394f00c989b4f2da113ceb4b3c47c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e7693c-5e6a-4876-9c1c-d965225dc4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e7693c-5e6a-4876-9c1c-d965225dc4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6aba21b-70ec-4ff6-84c4-fad5dba62f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6aba21b-70ec-4ff6-84c4-fad5dba62f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e', 'volume_name': 'volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e', 'volume_size': 1, 'snapshot_id': '84d234cc-b2df-47e9-9e8f-4f04a536e85e'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc03b18-d960-45f4-8931-f0ae2a738ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc03b18-d960-45f4-8931-f0ae2a738ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d92b673-ccb5-48dc-be71-097ed0d807ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:30 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Volume 90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e', 'volume_size': 1, 'snapshot_id': '84d234cc-b2df-47e9-9e8f-4f04a536e85e'} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" by "_create_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Creating volume 90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e from snapshot 84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" by "_copy_volume_from_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] snapshot: 84d234cc-b2df-47e9-9e8f-4f04a536e85e, volume: 90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e, {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 12:57:30 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d" returned: 0 in 0.426s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8992c-113d-4b09-8a62-6f0e413d1826]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:30 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d Sep 01 12:57:30 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:30 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:30 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:30 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-48282d8a-855d-427e-ad3b-563506166c6d" returned: 0 in 0.311s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-48282d8a-855d-427e-ad3b-563506166c6d" released by "delete_volume" :: held 0.807s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Created reservations ['4045851a-6c57-4e01-8a15-76345f96166a', 'ffabdc6f-90d7-4359-90dc-44ff13ef6ba7', 'b32a8f5c-c810-4365-a614-c7dd7f2b011f', '75cc640d-3e96-43ef-be90-e235466804f7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:30 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.450s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:30 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabbceb3-15a9-4085-94f1-9e7deaa3eaaa]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:31 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:31 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:31 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:31 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:31 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.341s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:31 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Deleted volume successfully. Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a454ea27-2c37-41a1-b469-1f2f6708e14b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-48282d8a-855d-427e-ad3b-563506166c6d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:31 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Creating direct copy from snapshot {{(pid=87008) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.utils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Path /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e not found in is_blk_device check {{(pid=87008) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:31 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e Sep 01 12:57:31 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (3e1a1fda-e4f0-4b21-91f9-ba815938d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9da2ee-c493-4c2a-a3a9-c46922b0794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9da2ee-c493-4c2a-a3a9-c46922b0794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301357206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e89ca90-dacd-46c2-afd3-d0e33504fa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:32Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583de621-907e-4ec6-87b9-c0ba3430c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583de621-907e-4ec6-87b9-c0ba3430c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9a159-129b-4fcb-9520-7dc0363ab29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9a159-129b-4fcb-9520-7dc0363ab29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e89ca90-dacd-46c2-afd3-d0e33504fa80', 'volume_name': 'volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e2705b-b271-4f00-874a-d6e953b0bad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e2705b-b271-4f00-874a-d6e953b0bad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec9892c-7124-480a-992b-f6376ceb056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:31 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Volume 6e89ca90-dacd-46c2-afd3-d0e33504fa80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80', 'volume_size': 1} Sep 01 12:57:31 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:35 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" returned: 0 in 4.290s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:35 devstack cinder-volume[87008]: DEBUG cinder.image.image_utils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Image conversion details: src /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e {{(pid=87008) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 12:57:35 devstack cinder-volume[87008]: INFO cinder.image.image_utils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Converted 1024.00 MB image at 238.65 MB/s Sep 01 12:57:35 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e is being set with open permissions: ugo+rw Sep 01 12:57:35 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:35 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e Sep 01 12:57:35 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:36 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" released by "_copy_volume_from_snapshot" :: held 5.587s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" released by "_create_volume_from_snapshot" :: held 5.650s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.668s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.990s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 3ac00252-1fd2-44bc-8c29-36ab2d2a26af of volume da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d92b673-ccb5-48dc-be71-097ed0d807ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e', 'volume_size': 1, 'snapshot_id': '84d234cc-b2df-47e9-9e8f-4f04a536e85e'}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3eec9-8d9f-4a8e-8b81-4883f75c9d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5103d83e-d866-4280-bd6e-e4d8b6645d1a]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:36 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Volume volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e (90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e): created successfully Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e3eec9-8d9f-4a8e-8b81-4883f75c9d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Flow 'volume_create_manager' (caa5a6a9-e569-4224-96e4-4ca3db63dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:36 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-90c423f5-207b-4e87-8cbf-9aeb41c5c7a4 tempest-SnapshotDependencyTests-754834849 None] Created volume successfully. Sep 01 12:57:36 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de Sep 01 12:57:36 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:36 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:36 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af 1G Sep 01 12:57:36 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:36 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af 1G" returned: 0 in 0.433s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da50b9b9-8626-416f-9d08-09d92b41b8de -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:36 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-84d234cc-b2df-47e9-9e8f-4f04a536e85e-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:36 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da50b9b9-8626-416f-9d08-09d92b41b8de -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af Sep 01 12:57:36 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-84d234cc-b2df-47e9-9e8f-4f04a536e85e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Deleting offline snapshot 84d234cc-b2df-47e9-9e8f-4f04a536e85e of volume d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] snapshot_file for this snap is: volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03c167-3e11-46dc-90d0-a90c9b27f0b4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:37 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:37 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:37 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da50b9b9-8626-416f-9d08-09d92b41b8de -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af" returned: 0 in 0.335s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af is being set with open permissions: ugo+rw Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:37 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af Sep 01 12:57:37 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:37 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.383s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[67368e40-5c5c-42cd-8b16-fe91255e4ab6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:37 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:37 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:37 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:37 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info Sep 01 12:57:37 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:37 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:37 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info is being set with open permissions: ugo+rw Sep 01 12:57:37 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:37 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info Sep 01 12:57:37 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.595s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:38 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:38 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.info" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301357206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e89ca90-dacd-46c2-afd3-d0e33504fa80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:32Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Creating volume 6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:38 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:38 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 1073741824 Sep 01 12:57:38 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fd7db1be-a4a7-4bb5-b675-bad9bb37aefd tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:38 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.347s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:38 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e Sep 01 12:57:38 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-3ac00252-1fd2-44bc-8c29-36ab2d2a26af-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-3ac00252-1fd2-44bc-8c29-36ab2d2a26af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-3ac00252-1fd2-44bc-8c29-36ab2d2a26af" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3ac00252-1fd2-44bc-8c29-36ab2d2a26af" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 3ac00252-1fd2-44bc-8c29-36ab2d2a26af of volume da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:38 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca2ad5-a659-408b-ab57-62a865a24254]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9.84d234cc-b2df-47e9-9e8f-4f04a536e85e" returned: 0 in 0.310s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:38 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 1073741824" returned: 0 in 0.565s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-84d234cc-b2df-47e9-9e8f-4f04a536e85e" released by "_delete_snapshot" :: held 1.746s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" released by "delete_snapshot" :: held 1.773s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:38 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af Sep 01 12:57:38 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 Sep 01 12:57:38 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Created reservations ['72c8f707-2029-4aa7-8a66-142fad37b430', 'de109a93-ead2-4ea1-894f-17aaf524b220', '3c29e84f-2958-4e09-b8ae-410e344b7ad1', 'ab7bcf48-1c0e-47a1-938d-b4c142f28f1b'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:38 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Delete snapshot completed successfully. Sep 01 12:57:38 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-22a19e47-d961-4965-bd53-f1b256e039db tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-84d234cc-b2df-47e9-9e8f-4f04a536e85e-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:39 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80" returned: 0 in 0.283s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:39 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec9892c-7124-480a-992b-f6376ceb056f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed85a2e-a4bf-44da-824e-92fa4a6441fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af" returned: 0 in 0.409s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da50b9b9-8626-416f-9d08-09d92b41b8de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ae16e-1fb3-46c1-bed0-3e20eb30387f]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-d5eb8767-e8d2-4d70-a927-0c5044b575e9-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:39 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Volume volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 (6e89ca90-dacd-46c2-afd3-d0e33504fa80): created successfully Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed85a2e-a4bf-44da-824e-92fa4a6441fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (3e1a1fda-e4f0-4b21-91f9-ba815938d67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:39 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-10c9e5bd-ed4d-4b4f-9fb0-e8c82d5375c1 tempest-ProjectReaderTests-1866619289 None] Created volume successfully. Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-d5eb8767-e8d2-4d70-a927-0c5044b575e9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:39 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de Sep 01 12:57:39 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a3a57-dd44-49d6-b366-c5e62a2c1b99]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:39 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:39 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Creating offline snapshot 0d250e89-d9f9-498d-9a91-ad00f25e5229 of volume 6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:39 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de" returned: 0 in 0.471s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2b727-3ad1-4ccd-bfa9-c54d1e5a8927]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:39 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af Sep 01 12:57:39 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:39 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.409s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:39 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:39 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 Sep 01 12:57:39 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:39 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9 Sep 01 12:57:39 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af" returned: 0 in 0.384s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80" returned: 0 in 0.398s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af Sep 01 12:57:40 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d5eb8767-e8d2-4d70-a927-0c5044b575e9" returned: 0 in 0.302s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 1G Sep 01 12:57:40 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-d5eb8767-e8d2-4d70-a927-0c5044b575e9" released by "delete_volume" :: held 0.797s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Created reservations ['0ac527a2-d525-48c8-80a2-db8c6ca000a8', 'baa8cf7d-fcda-496a-9148-c741f81b7fe1', 'd0c00ba7-6a05-4ba6-8a7c-cacd8e8f618e', 'c8d5b4d3-b03c-4b14-8ab6-3fc672c05852'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:40 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de.3ac00252-1fd2-44bc-8c29-36ab2d2a26af" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3ac00252-1fd2-44bc-8c29-36ab2d2a26af" released by "_delete_snapshot" :: held 1.674s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" released by "delete_snapshot" :: held 1.714s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Created reservations ['d8af93f4-716a-4d29-af62-be09144bf12c', '7e9d489f-9b4b-43da-91ea-b39fed39c9e6', '3861167a-97ec-434a-b075-78b9d2b774f2', 'd8c29648-b2b3-4d57-8f6e-3f02deb660f8'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b468c65-edd8-48db-a18d-3e34c42bc655]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 1G" returned: 0 in 0.514s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.358s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Deleted volume successfully. Sep 01 12:57:40 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 Sep 01 12:57:40 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-13960ac3-2a69-474d-90c9-2ed377aa8a3b tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-d5eb8767-e8d2-4d70-a927-0c5044b575e9-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:40 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c528fcfb-2ce5-4bc5-a6a8-348cdc0c61dc tempest-ProjectMemberTests-643974733 None] Lock "cinder-3ac00252-1fd2-44bc-8c29-36ab2d2a26af-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:40 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e Sep 01 12:57:40 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-da50b9b9-8626-416f-9d08-09d92b41b8de-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "cinder-da50b9b9-8626-416f-9d08-09d92b41b8de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[12094af6-7341-4ba4-9797-6facbfb97002]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 is being set with open permissions: ugo+rw Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:40 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" returned: 0 in 0.422s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:40 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 Sep 01 12:57:41 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e Sep 01 12:57:41 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de Sep 01 12:57:41 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-quobyte-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e" released by "delete_volume" :: held 0.764s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:41 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info Sep 01 12:57:41 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Created reservations ['f8ce0a4d-afc6-49af-a0ba-bb7f2c143977', '36eec3c0-84bf-436b-8dfb-0dd6a78394a2', '6a629d78-66ee-4a3d-aa57-f3572883e9fb', 'cdf3bcc7-f1f9-4408-b81b-cd81c14cffad'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de" returned: 0 in 0.401s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de Sep 01 12:57:41 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:41 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info" returned: 0 in 0.312s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info is being set with open permissions: ugo+rw Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info Sep 01 12:57:41 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:41 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-da50b9b9-8626-416f-9d08-09d92b41b8de" returned: 0 in 0.301s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-da50b9b9-8626-416f-9d08-09d92b41b8de" released by "delete_volume" :: held 0.783s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:41 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.336s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:41 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Deleted volume successfully. Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Created reservations ['42592c30-f2ef-4d4c-92ce-364c3ed91acc', 'f8400896-a747-4814-b9eb-09017e18e867', 'd05c075c-1c75-4b54-8998-c5df9affedd0', '9ccf5cea-c4c5-4413-a861-10536e673aff'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9b8f61db-4fb1-4425-9072-3df8eb270b0e tempest-SnapshotDependencyTests-754834849 None] Lock "cinder-90f0bc96-3b1c-40a1-a5c0-9b170f69ae3e-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:41 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.info" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:41 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:41 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:41 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-4fb9ab08-02bb-4e40-9914-70c3fb8ee7c1 tempest-ProjectReaderTests-1866619289 None] Create snapshot completed successfully Sep 01 12:57:42 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.294s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:42 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-eab21189-9a93-4b4f-89e0-1f008e42741f tempest-ProjectMemberTests-643974733 None] Lock "cinder-da50b9b9-8626-416f-9d08-09d92b41b8de-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (d5a4a75e-7fb6-4669-a3d7-5f1b6f84cc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5553a9d6-1acb-43ba-a280-95552d9ffac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5553a9d6-1acb-43ba-a280-95552d9ffac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570133259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786c6279-3702-4515-9669-afcb44b24128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:43Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fc5cbe-8ffe-4789-8e7b-f87dd3c6c256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fc5cbe-8ffe-4789-8e7b-f87dd3c6c256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f604c765-719d-4600-a4f9-a5ba976cd87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f604c765-719d-4600-a4f9-a5ba976cd87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786c6279-3702-4515-9669-afcb44b24128', 'volume_name': 'volume-786c6279-3702-4515-9669-afcb44b24128', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7457da6c-9745-45c5-968d-ec53bc4315e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7457da6c-9745-45c5-968d-ec53bc4315e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6178e7cc-d83e-4a93-a704-81019816f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:42 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Volume 786c6279-3702-4515-9669-afcb44b24128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786c6279-3702-4515-9669-afcb44b24128', 'volume_size': 1} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570133259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786c6279-3702-4515-9669-afcb44b24128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:43Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Creating volume 786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:42 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:42 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 1073741824 Sep 01 12:57:42 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-0d250e89-d9f9-498d-9a91-ad00f25e5229-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-0d250e89-d9f9-498d-9a91-ad00f25e5229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-0d250e89-d9f9-498d-9a91-ad00f25e5229" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-0d250e89-d9f9-498d-9a91-ad00f25e5229" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Deleting offline snapshot 0d250e89-d9f9-498d-9a91-ad00f25e5229 of volume 6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] snapshot_file for this snap is: volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3719fd-9a2c-4d5f-9feb-5dee01b76ad2]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:42 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:43 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 Sep 01 12:57:43 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:43 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 1073741824" returned: 0 in 0.513s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:43 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 Sep 01 12:57:43 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:43 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229" returned: 0 in 0.429s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e353756-aa88-40f9-a846-adf82e7be5b3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:43 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128" returned: 0 in 0.338s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6178e7cc-d83e-4a93-a704-81019816f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786c6279-3702-4515-9669-afcb44b24128', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:43 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 Sep 01 12:57:43 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a0d915-b217-4da0-ae0f-0a1237d55a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:43 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Volume volume-786c6279-3702-4515-9669-afcb44b24128 (786c6279-3702-4515-9669-afcb44b24128): created successfully Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a0d915-b217-4da0-ae0f-0a1237d55a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (d5a4a75e-7fb6-4669-a3d7-5f1b6f84cc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:43 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-f4724aef-7835-476d-a643-ae19be63bc29 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:57:43 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80" returned: 0 in 0.436s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:43 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:43 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 Sep 01 12:57:43 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:44 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229" returned: 0 in 0.369s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:44 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229 Sep 01 12:57:44 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:44 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80.0d250e89-d9f9-498d-9a91-ad00f25e5229" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-0d250e89-d9f9-498d-9a91-ad00f25e5229" released by "_delete_snapshot" :: held 1.646s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" released by "delete_snapshot" :: held 1.682s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Created reservations ['327d368c-e637-4f6e-aead-23d9a5f34e2f', 'b43a4337-dff1-4a5b-adce-35a6b7b612bf', '5b22fd73-82fb-4765-a925-5c8cb88f7402', 'f319c660-6593-4011-9b39-4cdac842fb34'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:44 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Delete snapshot completed successfully. Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-1497b0fc-79f7-48d8-9903-08bc71b132f0 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-0d250e89-d9f9-498d-9a91-ad00f25e5229-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 3868ca21-1107-4f65-bd2b-11cd2d57dc75 of volume 786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[687d9def-8903-4bd3-afef-4f052f4f772c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:44 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:45 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 Sep 01 12:57:45 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-6e89ca90-dacd-46c2-afd3-d0e33504fa80-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-6e89ca90-dacd-46c2-afd3-d0e33504fa80-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" acquired by "delete_volume" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d08d6d6-49ca-419f-9d3b-bb8ca3f96812]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:45 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 Sep 01 12:57:45 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:45 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:45 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 1G Sep 01 12:57:45 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:45 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80" returned: 0 in 0.427s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:45 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80 Sep 01 12:57:45 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:45 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 1G" returned: 0 in 0.592s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786c6279-3702-4515-9669-afcb44b24128 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:45 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6e89ca90-dacd-46c2-afd3-d0e33504fa80" returned: 0 in 0.336s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:45 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786c6279-3702-4515-9669-afcb44b24128 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 Sep 01 12:57:45 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:45 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6e89ca90-dacd-46c2-afd3-d0e33504fa80" released by "delete_volume" :: held 0.837s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Created reservations ['26208602-a8b6-430b-a408-aef83833dff4', '5a8cdc6f-68d1-41d1-9750-8de92b372cee', '7db0ccd6-89cd-4dbe-b731-5b9e87c26765', 'd3ed0e11-e664-422c-945b-a7a173c4c2c3'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:46 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:46 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:46 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786c6279-3702-4515-9669-afcb44b24128 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75" returned: 0 in 0.362s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 is being set with open permissions: ugo+rw Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:46 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 Sep 01 12:57:46 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:46 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.305s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:46 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Deleted volume successfully. Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ca6af609-bbea-4521-a90e-38fe11cb284b tempest-ProjectReaderTests-1866619289 None] Lock "cinder-6e89ca90-dacd-46c2-afd3-d0e33504fa80-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:46 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75" returned: 0 in 0.321s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:46 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info Sep 01 12:57:46 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (4a812a1f-08f3-43ba-b6ea-6593b1e4223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a69679-a667-4ca8-ae44-3436fadbecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:46 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info" returned: 0 in 0.347s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:46 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info is being set with open permissions: ugo+rw Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a69679-a667-4ca8-ae44-3436fadbecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698362547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254b2d3-d1a4-468a-b065-a30901384d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:47Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:46 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45838c3-615c-4c28-af94-61975ff80193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45838c3-615c-4c28-af94-61975ff80193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:47 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info Sep 01 12:57:47 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167530f1-880b-4b23-b15e-f63ae081ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167530f1-880b-4b23-b15e-f63ae081ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6254b2d3-d1a4-468a-b065-a30901384d27', 'volume_name': 'volume-6254b2d3-d1a4-468a-b065-a30901384d27', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa4f433-9f06-42ed-8dde-b3daab8bdbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa4f433-9f06-42ed-8dde-b3daab8bdbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9391616c-3b83-4257-96be-bd67c9dc3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:47 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Volume 6254b2d3-d1a4-468a-b065-a30901384d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6254b2d3-d1a4-468a-b065-a30901384d27', 'volume_size': 1} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:47 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.info" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698362547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254b2d3-d1a4-468a-b065-a30901384d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:47Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Creating volume 6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:47 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:47 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 1073741824 Sep 01 12:57:47 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:47 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ecfaa4be-7938-4092-8ed1-17eaf7ff101a tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:47 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 1073741824" returned: 0 in 0.530s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:47 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:47 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 Sep 01 12:57:47 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-3868ca21-1107-4f65-bd2b-11cd2d57dc75-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:48 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3868ca21-1107-4f65-bd2b-11cd2d57dc75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9391616c-3b83-4257-96be-bd67c9dc3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6254b2d3-d1a4-468a-b065-a30901384d27', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd998849-723c-4bd5-af14-85c3f699e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-3868ca21-1107-4f65-bd2b-11cd2d57dc75" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:48 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Volume volume-6254b2d3-d1a4-468a-b065-a30901384d27 (6254b2d3-d1a4-468a-b065-a30901384d27): created successfully Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd998849-723c-4bd5-af14-85c3f699e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (4a812a1f-08f3-43ba-b6ea-6593b1e4223e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3868ca21-1107-4f65-bd2b-11cd2d57dc75" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 3868ca21-1107-4f65-bd2b-11cd2d57dc75 of volume 786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:48 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-31cef65b-1ae9-4a9d-923b-c561b0e530d5 tempest-ProjectReaderTests-1866619289 None] Created volume successfully. Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0142df7f-ed84-4f21-893e-8b84b9b4f9bc]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:48 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 Sep 01 12:57:48 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:48 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75" returned: 0 in 0.376s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786c6279-3702-4515-9669-afcb44b24128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b69406-1876-43a8-a4c6-50934949a05c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:48 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:48 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 Sep 01 12:57:48 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:49 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Creating offline snapshot de6e1347-5670-4973-b67c-bbd7510a7683 of volume 6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128" returned: 0 in 0.475s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c2142-2084-40f0-9bdc-f2e247c6d9b4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:49 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 Sep 01 12:57:49 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:49 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 Sep 01 12:57:49 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:49 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:49 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75 Sep 01 12:57:49 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:49 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27" returned: 0 in 0.476s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:49 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 1G Sep 01 12:57:49 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:49 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128.3868ca21-1107-4f65-bd2b-11cd2d57dc75" returned: 0 in 0.295s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3868ca21-1107-4f65-bd2b-11cd2d57dc75" released by "_delete_snapshot" :: held 1.672s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" released by "delete_snapshot" :: held 1.716s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:49 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Created reservations ['991e1389-11c9-49a2-a88f-efd14c6261c4', '313a9394-0b1d-4551-9212-6020de523e1f', 'd2ca6e07-071f-4a95-82d0-1381f1832e36', 'a609a160-d5fb-48bf-b4c7-b302fa0dac26'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:50 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e7fd441d-1f2f-4545-a678-44b93e3b9d47 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3868ca21-1107-4f65-bd2b-11cd2d57dc75-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:50 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 1G" returned: 0 in 0.550s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6254b2d3-d1a4-468a-b065-a30901384d27 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:50 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6254b2d3-d1a4-468a-b065-a30901384d27 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 Sep 01 12:57:50 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-786c6279-3702-4515-9669-afcb44b24128-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "cinder-786c6279-3702-4515-9669-afcb44b24128-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a127803-e737-4798-892e-9fc01761bb82]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:50 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6254b2d3-d1a4-468a-b065-a30901384d27 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683" returned: 0 in 0.361s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:50 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 is being set with open permissions: ugo+rw Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:50 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 Sep 01 12:57:50 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:50 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 Sep 01 12:57:50 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:50 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683" returned: 0 in 0.307s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:50 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128" returned: 0 in 0.415s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:50 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128 Sep 01 12:57:50 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:50 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:50 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info Sep 01 12:57:50 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:51 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-786c6279-3702-4515-9669-afcb44b24128" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-786c6279-3702-4515-9669-afcb44b24128" released by "delete_volume" :: held 0.776s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=162,cinder:INSERT=51,cinder:UPDATE=182,cinder:DELETE=13 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:57:51 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:51 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info is being set with open permissions: ugo+rw Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:51 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info Sep 01 12:57:51 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Created reservations ['260b93e0-9466-4cac-ad61-e2dff15033bf', '0a355c7d-aed2-466b-8fad-c3ad7c0d8333', '4f16c181-fbc1-45db-bb65-ca4e4ceb3e35', '58242757-9f72-438b-a83f-f4115e7fc53d'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:51 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:51 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:51 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.info" returned: 0 in 0.277s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e2c75b41-3bee-4631-9864-55da1860125c tempest-ProjectReaderTests-1866619289 None] Create snapshot completed successfully Sep 01 12:57:51 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.312s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:51 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a2e72bdb-daac-44b5-ab5b-5a0481a76c1b tempest-ProjectMemberTests-643974733 None] Lock "cinder-786c6279-3702-4515-9669-afcb44b24128-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:INSERT=54,cinder:UPDATE=197,cinder:SELECT=142,cinder:DELETE=19 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (67ebb7d9-1456-4454-9543-709e810ad3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:51 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6705cd08-e16e-45ae-99bf-91bad30d2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6705cd08-e16e-45ae-99bf-91bad30d2475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363697551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190cfb73-bb20-4dd0-9a57-51e3b5341c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:52Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e8ca0-05b3-4806-baf7-31db2bb06535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e8ca0-05b3-4806-baf7-31db2bb06535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c24d41-4105-4d9b-a627-ea27286026b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c24d41-4105-4d9b-a627-ea27286026b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190cfb73-bb20-4dd0-9a57-51e3b5341c14', 'volume_name': 'volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0313c2-f61f-4563-8343-cadfe4ca477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0313c2-f61f-4563-8343-cadfe4ca477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df75ae0-c14a-4024-9f5c-921406ee2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:52 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Volume 190cfb73-bb20-4dd0-9a57-51e3b5341c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14', 'volume_size': 1} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363697551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190cfb73-bb20-4dd0-9a57-51e3b5341c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:52Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Creating volume 190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:52 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:52 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 1073741824 Sep 01 12:57:52 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-de6e1347-5670-4973-b67c-bbd7510a7683-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-de6e1347-5670-4973-b67c-bbd7510a7683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-de6e1347-5670-4973-b67c-bbd7510a7683" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-de6e1347-5670-4973-b67c-bbd7510a7683" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Deleting offline snapshot de6e1347-5670-4973-b67c-bbd7510a7683 of volume 6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] snapshot_file for this snap is: volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315cf28-d24d-4fb2-bdbd-7eae9c01e9b1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:52 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 Sep 01 12:57:52 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:52 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 1073741824" returned: 0 in 0.584s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:52 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 Sep 01 12:57:52 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:52 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683" returned: 0 in 0.433s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6254b2d3-d1a4-468a-b065-a30901384d27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ed258-c435-42ae-b8f0-136ee7b863b4]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:52 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14" returned: 0 in 0.305s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:52 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df75ae0-c14a-4024-9f5c-921406ee2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a038187-a3b2-4de6-a912-9bddcbbc1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:53 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Volume volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 (190cfb73-bb20-4dd0-9a57-51e3b5341c14): created successfully Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a038187-a3b2-4de6-a912-9bddcbbc1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (67ebb7d9-1456-4454-9543-709e810ad3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:53 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-eda5b5c4-3b1f-40c1-9e8a-f4551d4eabb2 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:57:53 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 Sep 01 12:57:53 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:53 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27" returned: 0 in 0.374s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:53 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 Sep 01 12:57:53 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:53 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:53 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683 Sep 01 12:57:53 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:53 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:53 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27.de6e1347-5670-4973-b67c-bbd7510a7683" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-de6e1347-5670-4973-b67c-bbd7510a7683" released by "_delete_snapshot" :: held 1.630s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" released by "delete_snapshot" :: held 1.663s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Created reservations ['88e317da-961e-4c9e-b727-4b869e75218e', 'c6bfc5dd-06e6-4b65-b0cd-2f4c88be0824', 'ae80fc2c-db93-43c9-a467-d3423d10cedd', '9053e06a-1b60-411d-8337-9f6fabae09b6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:54 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Delete snapshot completed successfully. Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-a50f6f21-96e7-4598-bf2b-ec45a32c3986 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-de6e1347-5670-4973-b67c-bbd7510a7683-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 4264fc26-4839-4673-b930-88b4bd9e018c of volume 190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3bb462-a826-4ba3-84ba-72d8dbe7305e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:54 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 Sep 01 12:57:54 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-6254b2d3-d1a4-468a-b065-a30901384d27-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-6254b2d3-d1a4-468a-b065-a30901384d27-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a1c89-5b89-487c-aec9-a2fae201f3f9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:54 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 Sep 01 12:57:54 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:54 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14" returned: 0 in 0.492s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:54 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:54 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c 1G Sep 01 12:57:54 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:55 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27" returned: 0 in 0.451s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:55 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27 Sep 01 12:57:55 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:55 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c 1G" returned: 0 in 0.485s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:55 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c Sep 01 12:57:55 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:55 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-6254b2d3-d1a4-468a-b065-a30901384d27" returned: 0 in 0.300s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-6254b2d3-d1a4-468a-b065-a30901384d27" released by "delete_volume" :: held 0.825s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Created reservations ['49057b0e-46d1-4028-bb52-96fb68ae5022', 'e4bea6d7-e148-46c7-b08c-6b2a5e0210d4', '2ee7f1e0-339e-4587-be89-dd66488d4b76', '1c09788a-e9e3-49ba-9188-2e964eb4c88c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:55 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:57:55 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c" returned: 0 in 0.345s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:55 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c is being set with open permissions: ugo+rw Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:55 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c Sep 01 12:57:55 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:55 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.299s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:57:55 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Deleted volume successfully. Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d2d46d9e-2ac1-49e0-8044-db1fb842a7f2 tempest-ProjectReaderTests-1866619289 None] Lock "cinder-6254b2d3-d1a4-468a-b065-a30901384d27-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:55 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:55 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c" returned: 0 in 0.337s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:56 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info Sep 01 12:57:56 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (541df1f6-b349-4a6e-95bb-4f33869da19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9edb9a-d345-4a10-8cee-19dec729be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9edb9a-d345-4a10-8cee-19dec729be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366120938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f1f06-7c82-4fc7-9f2b-58de437d80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:56Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d51050-6080-4b22-a656-2870b1377742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d51050-6080-4b22-a656-2870b1377742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd4d795-cd32-4d6b-b4ff-b04905f685f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd4d795-cd32-4d6b-b4ff-b04905f685f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04f1f06-7c82-4fc7-9f2b-58de437d80d2', 'volume_name': 'volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5490507e-d0df-46c0-be58-65e635375c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5490507e-d0df-46c0-be58-65e635375c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:56 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ecff8f-80e5-45e3-97f4-2a2b4dfafa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:56 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Volume d04f1f06-7c82-4fc7-9f2b-58de437d80d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2', 'volume_size': 1} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info" returned: 0 in 0.274s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:56 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info is being set with open permissions: ugo+rw Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:56 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info Sep 01 12:57:56 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:56 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.info" returned: 0 in 0.242s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366120938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f1f06-7c82-4fc7-9f2b-58de437d80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22069b41e8b54252a65824b0a641e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:57:56Z,use_quota=True,user_id='644c9226c9f34927b42cf18286dcd6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Creating volume d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:57:56 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:57:56 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:56 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 1073741824 Sep 01 12:57:56 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:56 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-08072c05-0d5f-4ca5-8f50-632e9b9f7baf tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:57:57 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 1073741824" returned: 0 in 0.409s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:57 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 Sep 01 12:57:57 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:57 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" returned: 0 in 0.241s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ecff8f-80e5-45e3-97f4-2a2b4dfafa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde217f7-c4bd-4639-ac67-1c21c4c646db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:57:57 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Volume volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 (d04f1f06-7c82-4fc7-9f2b-58de437d80d2): created successfully Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde217f7-c4bd-4639-ac67-1c21c4c646db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Flow 'volume_create_manager' (541df1f6-b349-4a6e-95bb-4f33869da19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:57:57 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-934f3613-119e-4a42-a62c-b4f558fe1a75 tempest-ProjectReaderTests-1866619289 None] Created volume successfully. Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-4264fc26-4839-4673-b930-88b4bd9e018c-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-4264fc26-4839-4673-b930-88b4bd9e018c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-4264fc26-4839-4673-b930-88b4bd9e018c" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4264fc26-4839-4673-b930-88b4bd9e018c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 4264fc26-4839-4673-b930-88b4bd9e018c of volume 190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e174a-d27e-4f59-b81b-df7ddfdfb60c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:57 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c Sep 01 12:57:57 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:57 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c" returned: 0 in 0.346s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257378e-dece-4ed3-8ce2-3f88510d01f3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:57 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:58 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 Sep 01 12:57:58 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:58 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14" returned: 0 in 0.368s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:58 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c Sep 01 12:57:58 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Creating offline snapshot 4c76fa5f-ab92-4f4e-8e25-6c88331372f8 of volume d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[21812c46-741b-40ae-9baa-3bdbbc5a6bc3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:58 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c" returned: 0 in 0.339s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:58 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 Sep 01 12:57:58 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:58 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c Sep 01 12:57:58 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:58 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14.4264fc26-4839-4673-b930-88b4bd9e018c" returned: 0 in 0.257s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:58 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4264fc26-4839-4673-b930-88b4bd9e018c" released by "_delete_snapshot" :: held 1.407s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" returned: 0 in 0.406s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" released by "delete_snapshot" :: held 1.438s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:58 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 1G Sep 01 12:57:58 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:58 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Created reservations ['feef91c9-7df3-4388-a272-262443e86d43', '88f2d326-904d-4e5d-9c59-03d8afdd9666', 'd591af9a-9403-45f1-a0aa-f17b78145587', 'c80e8e4b-49ff-46f2-a6f3-06acb8f8cc02'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:57:59 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-8ec0212d-bd5f-4665-b548-cc8b78ba2fa5 tempest-ProjectMemberTests-643974733 None] Lock "cinder-4264fc26-4839-4673-b930-88b4bd9e018c-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:57:59 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 1G" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:59 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 Sep 01 12:57:59 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:59 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-190cfb73-bb20-4dd0-9a57-51e3b5341c14-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8" returned: 0 in 0.314s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:59 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 is being set with open permissions: ugo+rw Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "cinder-190cfb73-bb20-4dd0-9a57-51e3b5341c14-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:59 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 Sep 01 12:57:59 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" acquired by "delete_volume" :: waited 0.025s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a2288-cf1a-42b6-8502-1b28f505a2f1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:59 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 Sep 01 12:57:59 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:57:59 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8" returned: 0 in 0.286s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:57:59 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:57:59 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info Sep 01 12:57:59 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:00 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:00 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:00 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14 Sep 01 12:58:00 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:00 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info is being set with open permissions: ugo+rw Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:00 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info Sep 01 12:58:00 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:00 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-190cfb73-bb20-4dd0-9a57-51e3b5341c14" returned: 0 in 0.267s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-190cfb73-bb20-4dd0-9a57-51e3b5341c14" released by "delete_volume" :: held 0.723s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:00 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.info" returned: 0 in 0.250s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-55befd03-f66c-4a28-bcd6-a5043ba617e6 tempest-ProjectReaderTests-1866619289 None] Create snapshot completed successfully Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Created reservations ['f5277a9c-a7fa-4102-99af-7a3fd7e19dc5', 'd4befb26-e02a-4056-8a01-8aa283d93d8d', '67cdc0fb-339c-4026-a7af-1fbeb6c5c83a', 'e3dcb9af-fc5e-41f4-b83c-818459aef9c6'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:00 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:00 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:00 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:00 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:58:00 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-419a6c5c-2bc3-4cf5-85f2-4fa68fc99b60 tempest-ProjectMemberTests-643974733 None] Lock "cinder-190cfb73-bb20-4dd0-9a57-51e3b5341c14-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (af904e3f-ef20-4ddc-bf67-6570dbe9b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b086e2-da23-41c0-8e01-b12c009743dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b086e2-da23-41c0-8e01-b12c009743dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46829714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a212fd4c-44f7-4189-8911-73468f8824a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:01Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12074c2a-ba02-43c5-8012-3c7806651c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12074c2a-ba02-43c5-8012-3c7806651c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a7d9f8-5964-43a0-8226-ccb4d803cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a7d9f8-5964-43a0-8226-ccb4d803cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a212fd4c-44f7-4189-8911-73468f8824a5', 'volume_name': 'volume-a212fd4c-44f7-4189-8911-73468f8824a5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67bb89-719c-465a-8c84-6ca34c33691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67bb89-719c-465a-8c84-6ca34c33691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c3f96f-48ce-4cf5-83f9-c23eb5ec46e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:01 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Volume a212fd4c-44f7-4189-8911-73468f8824a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a212fd4c-44f7-4189-8911-73468f8824a5', 'volume_size': 1} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46829714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a212fd4c-44f7-4189-8911-73468f8824a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:01Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Creating volume a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:01 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:01 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 1073741824 Sep 01 12:58:01 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-4c76fa5f-ab92-4f4e-8e25-6c88331372f8-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-4c76fa5f-ab92-4f4e-8e25-6c88331372f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-4c76fa5f-ab92-4f4e-8e25-6c88331372f8" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-4c76fa5f-ab92-4f4e-8e25-6c88331372f8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Deleting offline snapshot 4c76fa5f-ab92-4f4e-8e25-6c88331372f8 of volume d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] snapshot_file for this snap is: volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3d2d4e-14cd-4fbf-bac4-0031aed26a9c]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:01 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 1073741824" returned: 0 in 0.488s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:01 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:01 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 Sep 01 12:58:01 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:01 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 Sep 01 12:58:01 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:02 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c3f96f-48ce-4cf5-83f9-c23eb5ec46e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a212fd4c-44f7-4189-8911-73468f8824a5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbcef4a-ca9e-4e2d-9241-b2e15f625a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:02 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Volume volume-a212fd4c-44f7-4189-8911-73468f8824a5 (a212fd4c-44f7-4189-8911-73468f8824a5): created successfully Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbcef4a-ca9e-4e2d-9241-b2e15f625a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (af904e3f-ef20-4ddc-bf67-6570dbe9b8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:02 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-0e5269ec-11fe-425a-a379-d9b56d0f2d9a tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:58:02 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8" returned: 0 in 0.450s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[658843a6-c586-4f3c-ab5a-d15b1122bca1]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:02 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 Sep 01 12:58:02 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 649f0522-8f10-4829-a034-932ebb3be4ac of volume a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[98377003-0c43-4059-ad7a-043595614cbe]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:02 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 Sep 01 12:58:02 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:02 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" returned: 0 in 0.392s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:02 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 Sep 01 12:58:02 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:02 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:02 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:02 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac 1G Sep 01 12:58:02 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:03 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8" returned: 0 in 0.364s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:03 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8 Sep 01 12:58:03 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:03 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2.4c76fa5f-ab92-4f4e-8e25-6c88331372f8" returned: 0 in 0.285s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:03 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac 1G" returned: 0 in 0.421s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212fd4c-44f7-4189-8911-73468f8824a5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-4c76fa5f-ab92-4f4e-8e25-6c88331372f8" released by "_delete_snapshot" :: held 1.603s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" released by "delete_snapshot" :: held 1.636s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:03 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212fd4c-44f7-4189-8911-73468f8824a5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac Sep 01 12:58:03 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Created reservations ['33920466-d05e-4bfb-87ed-a9ffd6227b81', 'dbf02b8b-f655-4a57-a077-2d47e4bd60ac', 'fb2b1a0f-b43d-4a8a-b37c-6205c59f4fc1', '3c541ec7-27c1-4352-b87e-eba7007593b0'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:03 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Delete snapshot completed successfully. Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ce445952-1bd4-401f-90a9-c529dff6d13d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-4c76fa5f-ab92-4f4e-8e25-6c88331372f8-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:03 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a212fd4c-44f7-4189-8911-73468f8824a5 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac" returned: 0 in 0.308s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:03 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac is being set with open permissions: ugo+rw Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:03 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac Sep 01 12:58:03 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-d04f1f06-7c82-4fc7-9f2b-58de437d80d2-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-d04f1f06-7c82-4fc7-9f2b-58de437d80d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:03 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:03 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fea998-af24-4c90-91ae-ece364865e3b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:04 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info Sep 01 12:58:04 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:04 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 Sep 01 12:58:04 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:04 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info" returned: 0 in 0.280s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:04 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info is being set with open permissions: ugo+rw Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:04 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info Sep 01 12:58:04 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:04 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" returned: 0 in 0.399s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:04 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2 Sep 01 12:58:04 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:04 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.info" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:04 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-00be9865-b3e1-413e-9024-1a5724806a2d tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:58:04 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" returned: 0 in 0.273s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-quobyte-d04f1f06-7c82-4fc7-9f2b-58de437d80d2" released by "delete_volume" :: held 0.733s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Created reservations ['369c9b42-4424-486a-a162-f294f065cb79', '00189784-0310-4799-8bcf-b84791470fcd', 'eb56a7ae-8a49-41bd-9f19-8a8581317d11', '85cd0fa8-ad6a-47e0-99ec-221227d5696a'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:04 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:04 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:04 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:05 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:05 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Deleted volume successfully. Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-499b75a3-8309-4465-b8af-8a6cdd59df7d tempest-ProjectReaderTests-1866619289 None] Lock "cinder-d04f1f06-7c82-4fc7-9f2b-58de437d80d2-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-649f0522-8f10-4829-a034-932ebb3be4ac-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-649f0522-8f10-4829-a034-932ebb3be4ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-649f0522-8f10-4829-a034-932ebb3be4ac" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-649f0522-8f10-4829-a034-932ebb3be4ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 649f0522-8f10-4829-a034-932ebb3be4ac of volume a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c6f82c-b2db-447c-bae0-c72cc750f1b3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:05 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:05 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac Sep 01 12:58:05 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:06 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac" returned: 0 in 0.385s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a212fd4c-44f7-4189-8911-73468f8824a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6f3dad-e0c7-43ee-98c6-424a3b6cfe46]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:06 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 Sep 01 12:58:06 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:06 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5" returned: 0 in 0.401s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:06 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac Sep 01 12:58:06 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:06 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac" returned: 0 in 0.379s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:06 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:06 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac Sep 01 12:58:06 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:07 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5.649f0522-8f10-4829-a034-932ebb3be4ac" returned: 0 in 0.263s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-649f0522-8f10-4829-a034-932ebb3be4ac" released by "_delete_snapshot" :: held 1.539s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" released by "delete_snapshot" :: held 1.564s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Created reservations ['a3cf2656-0740-423b-87db-e78b39e5b1fa', '1afc14c1-5a81-4bc1-80d9-64a12488a1e3', '0b66670d-e865-4490-a7e9-2b507f958149', 'b3ee0c79-67d8-4148-b177-6f2d9e626012'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:07 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e908d7a4-c8a9-4e14-a2dc-409cacff76a2 tempest-ProjectMemberTests-643974733 None] Lock "cinder-649f0522-8f10-4829-a034-932ebb3be4ac-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-a212fd4c-44f7-4189-8911-73468f8824a5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "cinder-a212fd4c-44f7-4189-8911-73468f8824a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[931fcc52-02e9-4655-a9d7-d0c52d1101e9]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:07 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:08 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 Sep 01 12:58:08 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:08 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5" returned: 0 in 0.404s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:08 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5 Sep 01 12:58:08 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:08 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-a212fd4c-44f7-4189-8911-73468f8824a5" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-a212fd4c-44f7-4189-8911-73468f8824a5" released by "delete_volume" :: held 0.733s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Created reservations ['5ccf95c4-59eb-49f8-8463-efcb8f0256b6', '446833bd-a4e5-433f-ae71-60b656dd8c62', 'ef868b2d-8cb7-4e99-a5ed-4c780d8f91ea', 'c27a5348-58e5-4db9-bac0-5e20e950cc62'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:08 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:08 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (18b33862-9965-4073-866c-924f197bc6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e6995-f908-4696-a51e-3b2f267d237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e6995-f908-4696-a51e-3b2f267d237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830479337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7429e7-bd66-4b78-8473-1bd8430044c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:09Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:08 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47938507-2845-4dd0-b56d-bddab4f7bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47938507-2845-4dd0-b56d-bddab4f7bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09818026-90ae-4c6b-87e6-88e1754e8feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09818026-90ae-4c6b-87e6-88e1754e8feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7429e7-bd66-4b78-8473-1bd8430044c6', 'volume_name': 'volume-cd7429e7-bd66-4b78-8473-1bd8430044c6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbb27a-1912-4c67-b1b7-5b07eaa38059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdbb27a-1912-4c67-b1b7-5b07eaa38059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b631f96-8085-4260-a40e-05e6f5f2bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Volume cd7429e7-bd66-4b78-8473-1bd8430044c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7429e7-bd66-4b78-8473-1bd8430044c6', 'volume_size': 1} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830479337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7429e7-bd66-4b78-8473-1bd8430044c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:09Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Creating volume cd7429e7-bd66-4b78-8473-1bd8430044c6 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:09 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 1073741824 Sep 01 12:58:09 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:09 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2cab936f-4cda-443d-b439-078f5f237778 tempest-ProjectMemberTests-643974733 None] Lock "cinder-a212fd4c-44f7-4189-8911-73468f8824a5-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (30df5b47-c596-46aa-af7c-a7e8d5f91973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:09 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c534026-ea0b-47bc-81d4-630210fee9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 1073741824" returned: 0 in 0.504s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c534026-ea0b-47bc-81d4-630210fee9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597621798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b469bf-7ff6-4646-8907-e479c4d959d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:09Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99c8ed2-ae0e-4fff-a9f0-698ae80bc990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99c8ed2-ae0e-4fff-a9f0-698ae80bc990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3160d109-c38c-49b9-a8de-8f1a76d6cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3160d109-c38c-49b9-a8de-8f1a76d6cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b469bf-7ff6-4646-8907-e479c4d959d6', 'volume_name': 'volume-d3b469bf-7ff6-4646-8907-e479c4d959d6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647ae644-b7a5-48e3-b03f-71cb32647dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647ae644-b7a5-48e3-b03f-71cb32647dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad779529-2757-44ad-a3e8-bdc86e41ec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Volume d3b469bf-7ff6-4646-8907-e479c4d959d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b469bf-7ff6-4646-8907-e479c4d959d6', 'volume_size': 1} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:09 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 Sep 01 12:58:09 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:09 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6" returned: 0 in 0.256s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597621798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b469bf-7ff6-4646-8907-e479c4d959d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:09Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Creating volume d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b631f96-8085-4260-a40e-05e6f5f2bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7429e7-bd66-4b78-8473-1bd8430044c6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1838710-f6c0-4323-9624-7522be729315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:09 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 1073741824 Sep 01 12:58:09 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Volume volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 (cd7429e7-bd66-4b78-8473-1bd8430044c6): created successfully Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1838710-f6c0-4323-9624-7522be729315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:09 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (18b33862-9965-4073-866c-924f197bc6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:09 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-8bb3c024-3fad-42d8-a764-2c3350983b63 tempest-ProjectReaderTests-996730659 None] Created volume successfully. Sep 01 12:58:10 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 1073741824" returned: 0 in 0.414s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:10 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 Sep 01 12:58:10 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:10 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6" returned: 0 in 0.252s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad779529-2757-44ad-a3e8-bdc86e41ec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b469bf-7ff6-4646-8907-e479c4d959d6', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3e5b80-ff8b-44f3-baff-f7c34d74e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:10 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Volume volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 (d3b469bf-7ff6-4646-8907-e479c4d959d6): created successfully Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3e5b80-ff8b-44f3-baff-f7c34d74e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:10 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (30df5b47-c596-46aa-af7c-a7e8d5f91973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:10 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-fa8d392d-fd2e-43f9-9688-8a0099736adc tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-cd7429e7-bd66-4b78-8473-1bd8430044c6-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "cinder-cd7429e7-bd66-4b78-8473-1bd8430044c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-quobyte-cd7429e7-bd66-4b78-8473-1bd8430044c6" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-cd7429e7-bd66-4b78-8473-1bd8430044c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ba8589-31b2-4a72-b32a-912b27657f90]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:11 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 Sep 01 12:58:11 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:11 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6" returned: 0 in 0.366s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:11 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6 Sep 01 12:58:11 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 8b4f6300-a484-41d1-a4eb-ac8a677d52c4 of volume d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280c666-a858-4d99-91bf-9b73a9c3899b]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:11 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-cd7429e7-bd66-4b78-8473-1bd8430044c6" returned: 0 in 0.283s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:11 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 Sep 01 12:58:11 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-cd7429e7-bd66-4b78-8473-1bd8430044c6" released by "delete_volume" :: held 0.689s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:11 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Created reservations ['6839c370-bb10-4af4-a9e5-8a1be1e441d5', '25c7416a-2888-4197-b224-e182b618fefa', '1cb2d841-6b61-4872-b5c7-a98467bc7c53', '3f0ba01d-8b8b-428b-b465-4d3ff69498ce'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:12 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:12 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:12 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6" returned: 0 in 0.381s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:12 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 1G Sep 01 12:58:12 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:12 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.272s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:12 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Deleted volume successfully. Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-d97b315d-c203-4bcb-98d1-85203f03b8f9 tempest-ProjectReaderTests-996730659 None] Lock "cinder-cd7429e7-bd66-4b78-8473-1bd8430044c6-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:12 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 1G" returned: 0 in 0.443s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:12 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 Sep 01 12:58:12 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (10c86707-b70d-4711-a0d7-5bc0a76fb0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8822e-089d-432a-aa6a-597fbb23058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f8822e-089d-432a-aa6a-597fbb23058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643622183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12568b7c-0a94-4e87-bc12-9b410ff79ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:13Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360fdaeb-d8bf-47ca-ae45-5713302c70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360fdaeb-d8bf-47ca-ae45-5713302c70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3db47df-f5b3-42fd-b317-5a77f4c85d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3db47df-f5b3-42fd-b317-5a77f4c85d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12568b7c-0a94-4e87-bc12-9b410ff79ce5', 'volume_name': 'volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36143efa-c5f4-45b5-b2a4-cb3af14c5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36143efa-c5f4-45b5-b2a4-cb3af14c5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd8e8a-c7d9-4966-8df5-b6a7b76af917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:12 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Volume 12568b7c-0a94-4e87-bc12-9b410ff79ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5', 'volume_size': 1} Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:12 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4" returned: 0 in 0.321s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:12 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 is being set with open permissions: ugo+rw Sep 01 12:58:12 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:12 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 Sep 01 12:58:12 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:13 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4" returned: 0 in 0.244s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:13 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info Sep 01 12:58:13 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:13 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info" returned: 0 in 0.249s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:13 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info is being set with open permissions: ugo+rw Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:13 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info Sep 01 12:58:13 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:13 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.info" returned: 0 in 0.244s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643622183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12568b7c-0a94-4e87-bc12-9b410ff79ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:13Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Creating volume 12568b7c-0a94-4e87-bc12-9b410ff79ce5 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:13 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:13 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:13 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 1073741824 Sep 01 12:58:13 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:13 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-5656e9cc-e397-48a7-80b8-93cd08e0850a tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:58:14 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 1073741824" returned: 0 in 0.408s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:14 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 Sep 01 12:58:14 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:14 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5" returned: 0 in 0.244s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd8e8a-c7d9-4966-8df5-b6a7b76af917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdf7f15-3819-469e-b362-418e4d6b7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:14 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Volume volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 (12568b7c-0a94-4e87-bc12-9b410ff79ce5): created successfully Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdf7f15-3819-469e-b362-418e4d6b7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (10c86707-b70d-4711-a0d7-5bc0a76fb0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:14 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-322cfd16-71c7-4e72-9fd3-8a0c1fd34b26 tempest-ProjectReaderTests-996730659 None] Created volume successfully. Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-12568b7c-0a94-4e87-bc12-9b410ff79ce5-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-8b4f6300-a484-41d1-a4eb-ac8a677d52c4-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "cinder-12568b7c-0a94-4e87-bc12-9b410ff79ce5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:14 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-8b4f6300-a484-41d1-a4eb-ac8a677d52c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-8b4f6300-a484-41d1-a4eb-ac8a677d52c4" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-quobyte-12568b7c-0a94-4e87-bc12-9b410ff79ce5" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-8b4f6300-a484-41d1-a4eb-ac8a677d52c4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 8b4f6300-a484-41d1-a4eb-ac8a677d52c4 of volume d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-12568b7c-0a94-4e87-bc12-9b410ff79ce5" acquired by "delete_volume" :: waited 0.037s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8b76f-1cd5-413b-9e83-9394fe484dd3]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[01086ae7-cc38-4f39-8cfd-7528c1bff34e]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 Sep 01 12:58:15 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:15 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 Sep 01 12:58:15 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:15 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5" returned: 0 in 0.357s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4" returned: 0 in 0.385s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b469bf-7ff6-4646-8907-e479c4d959d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:58:15 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5 Sep 01 12:58:15 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83de63-3c5a-4a82-95c4-0d1acb797a37]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 Sep 01 12:58:15 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:15 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-12568b7c-0a94-4e87-bc12-9b410ff79ce5" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-12568b7c-0a94-4e87-bc12-9b410ff79ce5" released by "delete_volume" :: held 0.661s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Created reservations ['f1d10e3d-a848-40b7-acf5-a8387944da40', 'ff9ae9c6-bf2d-4396-ad94-b38ab8463ec0', 'fc04c114-ece6-47f7-893e-966bc655d812', 'c8253438-b402-4fbb-b9af-188e4289c11c'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6" returned: 0 in 0.391s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:15 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:15 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:15 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:15 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 Sep 01 12:58:15 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:16 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.270s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Deleted volume successfully. Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-ec389647-3dad-4c13-9e0e-d7c297366cdd tempest-ProjectReaderTests-996730659 None] Lock "cinder-12568b7c-0a94-4e87-bc12-9b410ff79ce5-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:16 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4" returned: 0 in 0.409s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:16 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4 Sep 01 12:58:16 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:16 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6.8b4f6300-a484-41d1-a4eb-ac8a677d52c4" returned: 0 in 0.262s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-8b4f6300-a484-41d1-a4eb-ac8a677d52c4" released by "_delete_snapshot" :: held 1.572s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" released by "delete_snapshot" :: held 1.605s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (7280b752-5b60-43f9-b01f-dd1097ce12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18607fc3-dc2d-411f-aa8e-a6bc70208e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18607fc3-dc2d-411f-aa8e-a6bc70208e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331982914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66efbf0-a5b1-43e5-b39a-ba235187e81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:17Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b9bea0-1df8-44f8-9ae6-977a5c890150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b9bea0-1df8-44f8-9ae6-977a5c890150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254ea901-25db-4223-ba2a-24383e9385ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254ea901-25db-4223-ba2a-24383e9385ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66efbf0-a5b1-43e5-b39a-ba235187e81d', 'volume_name': 'volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1cf488-fe2a-4069-a86e-f0faf90b0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1cf488-fe2a-4069-a86e-f0faf90b0b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77133b03-2dc8-4839-95bf-e3158e38297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:16 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Volume c66efbf0-a5b1-43e5-b39a-ba235187e81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d', 'volume_size': 1} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331982914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66efbf0-a5b1-43e5-b39a-ba235187e81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:17Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Creating volume c66efbf0-a5b1-43e5-b39a-ba235187e81d {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:16 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:16 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d 1073741824 Sep 01 12:58:16 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Created reservations ['94ad3aff-0580-43fb-9d93-13cbbedae9af', '3ab3c096-3705-4499-8e38-2f7e9e8feb06', '36d0bb04-f08e-48fd-945e-7aa62a7f399d', '40a7ce99-8702-4623-8970-4bf5a0016add'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:16 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:58:16 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-c0200879-7c9d-407b-9bd4-3073ec3263e6 tempest-ProjectMemberTests-643974733 None] Lock "cinder-8b4f6300-a484-41d1-a4eb-ac8a677d52c4-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-d3b469bf-7ff6-4646-8907-e479c4d959d6-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "cinder-d3b469bf-7ff6-4646-8907-e479c4d959d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" acquired by "delete_volume" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:17 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d 1073741824" returned: 0 in 0.508s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[473a6128-02b5-46e1-85fa-c51c8e2eb5a5]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:17 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d Sep 01 12:58:17 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:17 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 Sep 01 12:58:17 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:17 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d" returned: 0 in 0.269s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77133b03-2dc8-4839-95bf-e3158e38297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93bf5c7-cebc-4e3e-9668-240b919a09e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:17 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Volume volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d (c66efbf0-a5b1-43e5-b39a-ba235187e81d): created successfully Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93bf5c7-cebc-4e3e-9668-240b919a09e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (7280b752-5b60-43f9-b01f-dd1097ce12c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:17 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-6ec3b66a-7ebc-45c8-88f7-f468f41bd785 tempest-ProjectReaderTests-996730659 None] Created volume successfully. Sep 01 12:58:17 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6" returned: 0 in 0.396s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:17 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6 Sep 01 12:58:17 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:17 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-d3b469bf-7ff6-4646-8907-e479c4d959d6" returned: 0 in 0.253s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-d3b469bf-7ff6-4646-8907-e479c4d959d6" released by "delete_volume" :: held 0.714s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:17 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Created reservations ['55c9737e-4c6b-41d2-b00f-de38a12a528d', 'b98506a2-76e2-4b79-ac6b-64114f98da6e', '60add6e4-a2be-40b5-95ac-96fac8e37cd3', '83924892-9a45-4045-8400-72fcbd5128da'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:18 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:18 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:18 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.268s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:18 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-9db62aa8-c967-4003-9b30-cdff85f36907 tempest-ProjectMemberTests-643974733 None] Lock "cinder-d3b469bf-7ff6-4646-8907-e479c4d959d6-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-c66efbf0-a5b1-43e5-b39a-ba235187e81d-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "cinder-c66efbf0-a5b1-43e5-b39a-ba235187e81d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (22011ae8-50fa-4e36-8467-6e2a6111cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2a1186-3a8d-44c2-991f-951d3379228b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-quobyte-c66efbf0-a5b1-43e5-b39a-ba235187e81d" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2a1186-3a8d-44c2-991f-951d3379228b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969921891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b9d17-c8eb-4d1c-9051-8720dd8ece39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:19Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e193c9-a932-4d2b-905c-cc8a36cec919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e193c9-a932-4d2b-905c-cc8a36cec919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31211d9-e5ba-49b5-9332-f051d18474d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31211d9-e5ba-49b5-9332-f051d18474d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9b9d17-c8eb-4d1c-9051-8720dd8ece39', 'volume_name': 'volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6621ab30-4840-42bf-810a-1d1bef8378b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6621ab30-4840-42bf-810a-1d1bef8378b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194a1541-ccde-4d78-9937-20d0a6cd7679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:18 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Volume 4c9b9d17-c8eb-4d1c-9051-8720dd8ece39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39', 'volume_size': 1} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969921891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b9d17-c8eb-4d1c-9051-8720dd8ece39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a0bac8546d45788de35d5dbc561325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:19Z,use_quota=True,user_id='f7b90b1887d74ace9c5568be14e5c0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Creating volume 4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:18 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-c66efbf0-a5b1-43e5-b39a-ba235187e81d" acquired by "delete_volume" :: waited 0.077s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:18 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 1073741824 Sep 01 12:58:18 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[97518a0b-ed40-4600-9e9c-b0b447ecafed]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:18 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:19 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d Sep 01 12:58:19 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:19 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d" returned: 0 in 0.389s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:19 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 1073741824" returned: 0 in 0.464s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:19 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d Sep 01 12:58:19 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:19 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 Sep 01 12:58:19 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:19 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-c66efbf0-a5b1-43e5-b39a-ba235187e81d" returned: 0 in 0.266s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-c66efbf0-a5b1-43e5-b39a-ba235187e81d" released by "delete_volume" :: held 0.704s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:19 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" returned: 0 in 0.279s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Created reservations ['8d16f376-cb18-4bbd-ad0c-e00bd586975d', 'c6ec93c6-a8d9-414b-afe6-07c0d2c868d4', 'af4b9107-245a-4720-89b0-4996e2fdccd1', 'e1731dc8-6c32-4fda-a3ed-7c600e7ef372'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194a1541-ccde-4d78-9937-20d0a6cd7679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e51913-4f5e-41b3-a694-d83df294e06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:19 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Volume volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 (4c9b9d17-c8eb-4d1c-9051-8720dd8ece39): created successfully Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e51913-4f5e-41b3-a694-d83df294e06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Flow 'volume_create_manager' (22011ae8-50fa-4e36-8467-6e2a6111cc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:19 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-01407bb9-f0e1-46f9-8c6e-efef956e8728 tempest-ProjectMemberTests-643974733 None] Created volume successfully. Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:19 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:19 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:19 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:20 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:20 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Deleted volume successfully. Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-2ad07961-bd29-499a-9c52-ba113ef21867 tempest-ProjectReaderTests-996730659 None] Lock "cinder-c66efbf0-a5b1-43e5-b39a-ba235187e81d-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.flows.manager.create_volume [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87008) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (32685007-03a9-4a97-b050-714aad0e3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8385ef01-4c7b-4c61-9126-fc234ee40e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8385ef01-4c7b-4c61-9126-fc234ee40e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086773509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06564cb3-2f71-4bdb-b589-248efadbcd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:20Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d85acb2-fa9b-4c72-a686-70f06c64a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d85acb2-fa9b-4c72-a686-70f06c64a181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1850d83-0f4b-4283-aa7a-399ded48397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1850d83-0f4b-4283-aa7a-399ded48397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06564cb3-2f71-4bdb-b589-248efadbcd70', 'volume_name': 'volume-06564cb3-2f71-4bdb-b589-248efadbcd70', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6dbb805-fb73-44d0-80aa-846b0588fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6dbb805-fb73-44d0-80aa-846b0588fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db38189d-910d-4022-b12c-655e1b03fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:20 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Volume 06564cb3-2f71-4bdb-b589-248efadbcd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06564cb3-2f71-4bdb-b589-248efadbcd70', 'volume_size': 1} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T10:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086773509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06564cb3-2f71-4bdb-b589-248efadbcd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f35bb652d44959aff22dd6406d4b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T10:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T10:58:20Z,use_quota=True,user_id='58ca8d6f01874b7d842ff2c1459d9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a4f1b59-94a6-4839-b926-0837adf99645),volume_type_id=3a4f1b59-94a6-4839-b926-0837adf99645)}" {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Creating volume 06564cb3-2f71-4bdb-b589-248efadbcd70 {{(pid=87008) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Selected osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 as target Quobyte volume. {{(pid=87008) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 12:58:20 devstack cinder-volume[87008]: INFO cinder.volume.drivers.remotefs [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] casted to osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3 Sep 01 12:58:20 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 1073741824 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:20 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 1073741824 Sep 01 12:58:20 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:21 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 1073741824" returned: 0 in 0.507s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:21 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 Sep 01 12:58:21 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:21 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'} {{(pid=87008) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.253s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db38189d-910d-4022-b12c-655e1b03fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06564cb3-2f71-4bdb-b589-248efadbcd70', 'volume_size': 1}' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd1db85-cfab-47e1-9b51-c468b5033f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Creating offline snapshot 3f94bcf5-aafe-4cb8-984f-0ee820c4865e of volume 4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 12:58:21 devstack cinder-volume[87008]: INFO cinder.volume.flows.manager.create_volume [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Volume volume-06564cb3-2f71-4bdb-b589-248efadbcd70 (06564cb3-2f71-4bdb-b589-248efadbcd70): created successfully Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd1db85-cfab-47e1-9b51-c468b5033f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87008) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Flow 'volume_create_manager' (32685007-03a9-4a97-b050-714aad0e3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87008) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee3d56-f089-4f49-bec1-4b64ebde6c9d]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:21 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-008e9525-38a7-40d3-8bfe-3e578f747587 tempest-ProjectReaderTests-996730659 None] Created volume successfully. Sep 01 12:58:21 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 Sep 01 12:58:21 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:21 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" returned: 0 in 0.372s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:21 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e 1G {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:21 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e 1G Sep 01 12:58:21 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:22 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e 1G" returned: 0 in 0.402s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:22 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e Sep 01 12:58:22 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:22 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 -F qcow2 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e" returned: 0 in 0.302s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:22 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e is being set with open permissions: ugo+rw Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:22 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e Sep 01 12:58:22 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-06564cb3-2f71-4bdb-b589-248efadbcd70-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "cinder-06564cb3-2f71-4bdb-b589-248efadbcd70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Acquiring lock "cinder-quobyte-06564cb3-2f71-4bdb-b589-248efadbcd70" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-06564cb3-2f71-4bdb-b589-248efadbcd70" acquired by "delete_volume" :: waited 0.019s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae834af-f6c5-43ad-a7df-ad083a9ca8f0]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:22 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e" returned: 0 in 0.264s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:22 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:22 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 Sep 01 12:58:22 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:22 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info Sep 01 12:58:22 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:23 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info" returned: 0 in 0.264s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:23 devstack cinder-volume[87008]: WARNING cinder.volume.drivers.remotefs [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info is being set with open permissions: ugo+rw Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:23 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70" returned: 0 in 0.397s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:23 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info Sep 01 12:58:23 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:23 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70 Sep 01 12:58:23 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:23 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:23 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-06564cb3-2f71-4bdb-b589-248efadbcd70" returned: 0 in 0.259s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.info" returned: 0 in 0.289s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "cinder-quobyte-06564cb3-2f71-4bdb-b589-248efadbcd70" released by "delete_volume" :: held 0.720s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-2d7de2b3-ec3a-4840-a59d-57c91df3ed9b tempest-ProjectMemberTests-643974733 None] Create snapshot completed successfully Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Created reservations ['2a39f59e-13ea-486a-a5dc-d9abb05a2d93', 'a0980048-5c03-4071-9719-9384c767593f', 'f452b8c2-c478-44ad-ad86-ca9849827d23', 'dab8a856-0800-4861-b62b-dadba6989fe5'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:23 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:23 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:23 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:23 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Deleted volume successfully. Sep 01 12:58:23 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-16735607-50d5-4157-b531-933a3e186e2c tempest-ProjectReaderTests-996730659 None] Lock "cinder-06564cb3-2f71-4bdb-b589-248efadbcd70-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-3f94bcf5-aafe-4cb8-984f-0ee820c4865e-delete_snapshot" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3f94bcf5-aafe-4cb8-984f-0ee820c4865e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" by "delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-3f94bcf5-aafe-4cb8-984f-0ee820c4865e" by "_delete_snapshot" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3f94bcf5-aafe-4cb8-984f-0ee820c4865e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Deleting offline snapshot 3f94bcf5-aafe-4cb8-984f-0ee820c4865e of volume 4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] snapshot_file for this snap is: volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c7e40-151c-45d6-b7ba-1b5f382e80a6]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:24 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e Sep 01 12:58:24 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:24 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e" returned: 0 in 0.419s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.remotefs [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87008) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c1310-fe0a-4ff9-9ff6-2d0d3e086b29]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:24 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:25 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 Sep 01 12:58:25 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:25 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" returned: 0 in 0.395s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:25 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e Sep 01 12:58:25 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:25 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e" returned: 0 in 0.358s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:25 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e Sep 01 12:58:25 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:25 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39.3f94bcf5-aafe-4cb8-984f-0ee820c4865e" returned: 0 in 0.260s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-3f94bcf5-aafe-4cb8-984f-0ee820c4865e" released by "_delete_snapshot" :: held 1.550s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:25 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" released by "delete_snapshot" :: held 1.573s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Created reservations ['86b7b1c0-41c4-4b02-ad64-d6355aea0511', 'fb59991e-f738-448f-834b-a831e2eca10f', 'a71e191c-e12d-4c9c-b15a-017de9ad98ce', 'dde6c631-b2e5-40a6-b055-a7bd7f7d09c7'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:26 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Delete snapshot completed successfully. Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e0d67c72-075b-46c6-b79e-1d0dd9a56b70 tempest-ProjectMemberTests-643974733 None] Lock "cinder-3f94bcf5-aafe-4cb8-984f-0ee820c4865e-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39-delete_volume" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "cinder-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Acquiring lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" by "delete_volume" {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" acquired by "delete_volume" :: waited 0.018s {{(pid=87008) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b2eede-d261-4977-bf14-4a86d03b7ef7]: (4, 'qcow2') {{(pid=88456) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:26 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:26 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:26 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 Sep 01 12:58:26 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:26 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.281s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG oslo_service.periodic_task [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] Running periodic task VolumeManager._thread_info {{(pid=87008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread count: 28 {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 12:58:26 devstack cinder-volume[87008]: DEBUG cinder.volume.manager [None req-0e85eac4-0a72-4583-9974-cbfc24e705ce None None] thread info: [<_MainThread(MainThread, started 135665799233664)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 12:58:27 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" returned: 0 in 0.402s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:27 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39 Sep 01 12:58:27 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:27 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab/volume-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" returned: 0 in 0.258s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "cinder-quobyte-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39" released by "delete_volume" :: held 0.719s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.quota [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Created reservations ['e876e70b-db4f-4bac-b980-773120d70142', '9fe9006a-a9fc-43d8-b795-a454228ea38e', 'f9a61d05-970c-43a6-bd2e-8898985abed8', 'af7bf2d9-5db9-4620-9798-60e8cc0f06dc'] {{(pid=87008) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3': None} {{(pid=87008) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.volume.drivers.quobyte [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-de63b380-1dc6-48d9-94ab-2da3456138f3'] {{(pid=87008) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.lockutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87008) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 12:58:27 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab Sep 01 12:58:27 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 12:58:27 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG oslo_concurrency.processutils [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343d25750f7fad6b4b00c41000bdf8ab" returned: 0 in 0.282s {{(pid=87008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.manager [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Notifying Schedulers of capabilities ... {{(pid=87008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 12:58:27 devstack cinder-volume[87008]: INFO cinder.volume.manager [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Deleted volume successfully. Sep 01 12:58:27 devstack cinder-volume[87008]: DEBUG cinder.coordination [None req-e913b6b7-4c4a-419b-af53-578fe15ab540 tempest-ProjectMemberTests-643974733 None] Lock "cinder-4c9b9d17-c8eb-4d1c-9051-8720dd8ece39-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87008) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 12:58:37 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:UPDATE=162,cinder:SELECT=118,cinder:DELETE=14,cinder:INSERT=37 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 12:58:37 devstack cinder-volume[87008]: DEBUG dbcounter [-] [87008] Writing DB stats cinder:SELECT=99,cinder:UPDATE=141,cinder:INSERT=41,cinder:DELETE=11 {{(pid=87008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}